Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

This statement both ignores the tremendous effect smartphones have on you personally (as opposed to others being interested in you), and the tremendous effect tech platforms have on large scale groups of unimportant people.


Oh no doubt, and it does so intentionally. A voice assistant in my house effects me and only me. Therefore, I am ok with the privacy/convenience tradeoff because frankly IDK what Google thinks they know about me, but I google way too much random crap to ever put together a half-way decent profile about me and my interests.


The whole point of big data is finding patterns in large amounts of seemingly random information.


Maybe, but HFT have been working a long time to find a pattern in the markets. Human's are random and Sampling can only tell you so much especially when sampling bias is so easy to do accidentally


Humans can be spontaneous yes, but not exactly random. In aggregate, human behavior from online activities is predictable [0] according to Seth Stephens-Davidowitz in Everybody Lies.

0: https://www.amazon.com/gp/aw/review/B01AFXZ2F4/R2TPT5454UEKL...


To Quote the link you just posted, "Secondly, it's usually quite hard to control for all possible variables that may reflect a Google search; for instance in concluding that racism contributes the most to a particular political behavior, it's very hard to tease out all other factors that also may do so, especially when you are talking about a heterogeneous collection of human beings. How can you know that you have corrected for every possible factor? Thirdly and finally, the "science" part of "data science" still lacks rigor in my opinion. For instance, a lot of the conclusions the book talks about are based on single studies which don't seem to be repeated. In some cases the sample sizes are large, but in other cases they are small. Plus, people's opinions can change over time, so it's important to pick the right time window in which to do the study. All this points to great responsibility on the part of data scientists to make sure that their results are rigorous and not too simplistic, before they are taken up by both politicians and the general public as blunt instruments to change social policies. This responsibility increases especially as these approaches become more widespread and cheaper to use, especially in the hands of non-specialists. When you are in possession of a hammer, everything starts looking like a nail." - Thank you for making my point for me.


You are not necessarily disagreeing with what I wrote about correlation, that humans are predictable in aggregate, which is the opposite of your point that humans are random (in aggregate).

The text you quoted is disagreeing with the author with respect to the use of correlations to explain causality, which we both know will lead nowhere if all confounding variables are not properly accounted for; something which is infeasible to do in the real world.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: