How should we approach the problem of excessive data collection?

I started the idea of multi-tenancy for IoT, realistically multi-tenancy for data back in 2016. The basic idea is, we need to find the right way to get the maximum value out of the infrastructure we're building, and thereby not create even more sets of data about the same stuff. I have no idea if this is even possible, but I've used a similar model for infrastructure design and build in the past. What if you could work with manufacturers from an application standpoint to define data value prioritization and retention models that applied to specific operational environments like shop floor or manufacturing machines, to where you could apply a policy that could be defined for you. While it sounds great, the reason I think it would never work is that there's never been a time where somebody has said, "Well, can you be 100% certain that I'll never want to go back and look at that data?

Anonymous Author
I started the idea of multi-tenancy for IoT, realistically multi-tenancy for data back in 2016. The basic idea is, we need to find the right way to get the maximum value out of the infrastructure we're building, and thereby not create even more sets of data about the same stuff. I have no idea if this is even possible, but I've used a similar model for infrastructure design and build in the past. What if you could work with manufacturers from an application standpoint to define data value prioritization and retention models that applied to specific operational environments like shop floor or manufacturing machines, to where you could apply a policy that could be defined for you. While it sounds great, the reason I think it would never work is that there's never been a time where somebody has said, "Well, can you be 100% certain that I'll never want to go back and look at that data?
0 upvotes
Anonymous Author
Ultimately, if you think that saving data is a commodity, let somebody do it. As long as you focus on the procedures for deriving intelligence, you’re good. So you hand it off to somebody else to store it.
1 upvotes
Anonymous Author
How do you define excessive? I would start with a different question, what is the business value of the data and how is it going to be used? By starting there you can determine the purpose and value, and maybe that data is no longer excessive?
3 upvotes
Anonymous Author
It’s about sifting through the ever-expanding mountain of data and reading out meaningful content. More is NOT better. More is just more. One of my preferred techniques is combining multiple pieces of data into single indexed results — i.e. making more into less and building digestible meaning.
1 upvotes