15
$\begingroup$

This is sort of an open ended question but I wanna be clear. Given a sufficient population you might be able to learn something (this is the open part) but whatever you learn about your population, when is it ever applicable to a member of the population?

From what I understand of statistics it's never applicable to a single member of a population, however, all to often I find myself in a discussion where the other person goes "I read that 10% of the world population has this disease" and continue to conclude that every tenth person in the room has this disease.

I understand that ten people in this room is not a big enough sample for the statistic to be relevant but apparently a lot don't.

Then there's this thing about large enough samples. You only need to probe a large enough population to get reliable statistics. This though, isn't it proportional to the complexity of the statistic? If I'm measuring something that's very rare, doesn't that mean I need a much bigger sample to be able to determine the relevance for such a statistic?

The thing is, I truly question the validity of any newspaper or article when statistics is involved, they way it's used to build confidence.

That's a bit of background.

Back to the question, in what ways can you NOT or may you NOT use statistics to form an argument. I negated the question because I'd like to find out more about common misconceptions regarding statistics.

Improve this question
$\endgroup$
5
  • 2
    $\begingroup$ This is only a very partial answer, so I won't actually post it as an answer. You ARE correct that complex statistics need larger populations; you're referring to the concept of "degrees of freedom", which is simply the number of independent variables minus one. Also, when doing something like a p-test, your rejection threshold depends on the number of degrees of freedom in addition to the p-value you chose (typically .05). $\endgroup$
    – El'endia Starman
    Commented May 11, 2011 at 17:55
  • 2
    $\begingroup$ If more people read Hooke's How to Tell the Liars from the Statisticians, maybe there won't be as many "statistical suckers" as we now have in the world. $\endgroup$
    – J. M. is not a statistician
    Commented May 11, 2011 at 18:11
  • 1
    $\begingroup$ I think you might benefit from asking this question on stats stackexchange -- I flagged the question so maybe it will be moved over there. $\endgroup$
    – InterestedGuest
    Commented May 11, 2011 at 18:27
  • $\begingroup$ I didn't even know we had a forum dedicated to statistical analysis. I'd move the question, If I knew how... $\endgroup$
    – John Leidegren
    Commented May 11, 2011 at 19:00
  • 3
    $\begingroup$ @J.M., or Huff's How to Lie With Statistics $\endgroup$
    – Peter Taylor
    Commented May 11, 2011 at 21:14

8 Answers 8

Reset to default
2
$\begingroup$

To make conclusions about a group based on the population the group must be representative of the population and independent. Others have discussed this, so I will not dwell on this piece.

One other thing to consider is the non-intuitivness of probabilities. Let's assume that we have a group of 10 people who are independent and representative of the population (random sample) and that we know that in the population 10% have a particular characteristic. Therefore each of the 10 people has a 10% chance of having the characteristic. The common assumption is that it is fairly certain that at least 1 will have the characteristic. But that is a simple binomial problem, we can calculate the probability that none of the 10 have the characteristic, it is about 35% (converges to 1/e for bigger group/smaller probability) which is much higher than most people would guess. There is also a 26% chance that 2 or more people have the characteristic.

Improve this answer
$\endgroup$
9
$\begingroup$

Unless the people in the room are a random sample of the world's population, any conclusions based on statistics about the world's population are going to be very suspect. One out of every 5 people in the world is Chinese, but none of my five children are...

Improve this answer
$\endgroup$
6
$\begingroup$

  1. To address overapplication of statistics to small samples, I recommend countering with well-known jokes ("I am so excited, my mother is pregnant again and my baby sibling will be Chinese." "Why?" "I have read that every fourth baby is Chinese.").

  2. Actually, I recommend jokes to address all kinds of misconception in statistics, see http://xkcd.com/552/ for correlation and causation.

  3. The problem with newspaper articles is rarely the fact that they treat a rare phenomenon.

  4. Simpsons's paradox comes to mind as example that statistics can rarely be used without analysis of the causes.

Improve this answer
$\endgroup$
1
  • 2
    $\begingroup$ The variation of the "Chinese baby" joke I've heard had the expectant mother being afraid that her baby might be considered as an illegal alien and thus deported... $\endgroup$
    – J. M. is not a statistician
    Commented May 11, 2011 at 18:13
3
$\begingroup$

There is an interesting article by Mary Gray on misuse of statistics in court cases and things like that...

Gray, Mary W.; Statistics and the Law. Math. Mag. 56 (1983), no. 2, 67–81

Improve this answer
$\endgroup$
2
$\begingroup$

When it comes to logic and common sense, be careful, those two are rare. With certain "discussions" you might recognize something......the point of the argument is the argument.

http://www.wired.com/wiredscience/2011/05/the-sad-reason-we-reason/

Improve this answer
$\endgroup$
1
  • $\begingroup$ That's was a very intresting read. $\endgroup$
    – John Leidegren
    Commented May 12, 2011 at 5:56
2
$\begingroup$

Statistical analysis or statistical data?

I think this example in your question relates to statistical data: "I read that 10% of the world population has this disease". In other words, in this example some one is using numbers to help communicate quantity more effectively than just saying 'many people'.

My guess is that the answer to your question is hidden in the motivation of the speaker on why she is using numbers. It could be to communicate some notion better or it could be to show authority or it could be to dazzle the listener. The good thing about stating numbers rather than saying 'very big' is that people can refute the number. See Popper's idea on refutation.

Improve this answer
$\endgroup$
0
$\begingroup$

Hypothesis: $A$

(Textbook) Result: Do no reject $A$ ($\sigma = c$)

Your Statement: $A$ holds with probability $\sigma$!

Correct would be: In this case, you know nothing. If you want to "prove" $A$, your hypothesis has to be $\neg A$; reject it with $\sigma$ to get the desired statement.

Improve this answer
$\endgroup$
0
$\begingroup$

From what I understand of statistics it's never applicable to a single member of a population

It's not true. It depends on the application.

Example: nuclear decay in physics. The rate of decay, defines the probability of a decay of every single nucleus. You take any nucleus and it'll have exactly the same probability of decay, which you established by experimentation on the sample.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.