Timeline for Is sampling relevant in the time of 'big data'?
Current License: CC BY-SA 3.0
4 events
when toggle format | what | by | license | comment | |
---|---|---|---|---|---|
Oct 1, 2012 at 20:17 | comment | added | rrampage | @gung the issue is not the size of the sample, but the problem of generating an unbiased sample for a dataset which has a huge number of attributes. And generalization is usually done by Machine Learning algorithms, trained on a portion of the data set. The online data streams constantly coming in makes the issue of sampling secondary as batch updates can be used to change the parameters. | |
Oct 1, 2012 at 14:12 | comment | added | gung - Reinstate Monica | So is your point that they don't want to be able to generalize beyond the data they have to the data they don't yet? Or that they think their sample is so large they don't have to worry about those issues? Or that the underlying parameters would be changing over time, so is doesn't matter so long as they continue to update as new data flows in? | |
Sep 15, 2012 at 10:42 | review | First posts | |||
Oct 1, 2012 at 14:12 | |||||
Sep 15, 2012 at 10:42 | history | answered | rrampage | CC BY-SA 3.0 |