6
$\begingroup$

Problem

Take this (easy) problem as an example:

An astronomer is interested in measuring the distance, in light-years, from his observatory to a distant star. Although the astronomer has a measuring technique, he knows that, because of changing atmospheric conditions and normal error, each time a measurement is made it will not yield the exact distance, but merely an estimate. As a result, the astronomer plans to make a series of measurements and then use the average value of these measurements as his estimated value of the actual distance. If the astronomer believes that the values of the measurements are independent and identically distributed random variables having a common mean d (the actual distance) and a common variance of 4 (light-years), how many measurements need he make to be reasonably sure that his estimated distance is accurate to within 0.5 light-year?

Approaches

At first sight, what seemed to me more reasonable, was to use the Chebyshev's inequality as follows:

$X_{i}$ = distance in l.y. observed in experiment $i$

$E(X_{i})=\mu =d$

$Var(X_{i})=\sigma^{2} = 4$

Sample Mean:

$E(\bar{X}_{n})=\mu =d$

$Var(\bar{X}_{n})=\frac{\sigma^{2}}{n} = \frac{4}{n}$

So by Chebyshev's inequality we have:

$P(\left | \bar{X}_{n}-d \right | <0.5)>1-\frac{4}{n \cdot 0.5^{2}} \\ = 1- \frac{1}{n}\cdot \frac{4}{0.5^{2}} \\ = 1- \frac{16}{n}$

So if we consider the sentence "reasonably sure" as $0.95$, then $1- \frac{16}{n} = 0.95$ when $n= 320$.

So I would answer with: $n=320$ is enough.

But, Using the Central Limit Theorem we have that:

$P(\left | \bar{X}_{n}-d \right |\leq 0.5) \\ = P\left \{ \sqrt{n}\frac{\left | \bar{X}_{n}-d \right |}{2} \leq \frac{\sqrt{n}}{4}\right \}\\ =P\left ( \left | Z \right | \leq \frac{\sqrt{n}}{4} \right ) \\ \approx \Phi \left ( \frac{\sqrt{n}}{4} \right )-\Phi \left (- \frac{\sqrt{n}}{4} \right ) \\ =2\Phi \left ( \frac{\sqrt{n}}{4} \right )-1$

where symbol $\Phi(z)$ denotes the cumulative distribution function of a standard normal variable. Hence, $n$ should be, approximatively, the value such that:

$2\Phi \left ( \frac{\sqrt{n}}{4} \right )=0.975$

In other terms $\frac{\sqrt{n}}{4}$ is, approximatively, equal to the $97.5$% quantile of standard normal distribution. Using the normal table, we find that $\frac{\sqrt{n}}{4} = 1.96$ and thus $n = (1.96 \cdot 4)^{2} = 61.466$, thus $n$ must be equal to $62$, which is very different from the result I ended up with, which is $320$.

Questions

What's the reasoning behind this? This was an exercice I had to solve, but I used the Chebychev ineq. approach instead of the central limit theorem (used by my prof) and the results are very different. Is it correct? Am I missing something important?

Any clarification is appreciated.

| cite | improve this question | |
$\endgroup$
  • 1
    $\begingroup$ Your inequality is reversed. As $n$ increases, the probability that $X$ ls close to $d$ is decreasing as per your calculations. $\endgroup$ – Dilip Sarwate Dec 21 '15 at 12:41
  • $\begingroup$ yes I forgot 1-16/n, I edit $\endgroup$ – francescop Dec 21 '15 at 13:20
  • $\begingroup$ You wrote "variance of 4 (light-years)", which s dimensionally incorrect. Is the variance 4 light years squared, or is 4 light years the standard deviation? $\endgroup$ – Mark L. Stone Dec 21 '15 at 13:36
  • $\begingroup$ well it's an exercice taken from Ross, S. (2010). A First Course in Probability, 8th edition. Pearson Prentice Hall. I assume it's $\sigma^{2}$ 4 l.y. the variance of the random variables as I wrote. $\endgroup$ – francescop Dec 21 '15 at 13:53
5
$\begingroup$

Chebyshev's inequality works for any probability distribution (or large enough empirical data) while the CLT has stronger assumptions (independence, existence of moments, etc.). Its a good rule of thumb that if you want to reduce the number of assumptions in your model (or use a parametric model) you'll need more data in comparison and vice versa.

In this case, you can use the CLT and use less data.

| cite | improve this answer | |
$\endgroup$
  • $\begingroup$ Well thanks for your reply, I've checked the book and it actually says your same thing by solving the exercice with the chebychev inequality. $\endgroup$ – francescop Dec 21 '15 at 14:14
  • $\begingroup$ Ok, do you have any other questions on the problem? You seem not satisfied with this answer. $\endgroup$ – badbayesian Dec 21 '15 at 14:18
  • $\begingroup$ I'm wondering why to do this assumption, why using the CLT instead of Chebychev? It's purely for data or a good statistician would use it for other particular reasons? $\endgroup$ – francescop Dec 21 '15 at 14:31
  • 2
    $\begingroup$ Mostly it's because of efficiency and ease. Data isn't free so if you know some characteristics of the data it facilitates model building tremendously. To give an example, if we play hangman, it will be a lot easier for you to guess the word if you assume I played by the rules and only choose words in English. You'd have to check somehow that I play by the rules (maybe asking a ref) but if you're able to establish that I will play by the rules, you can discard a large amount of potential solutions and solve the problem faster and cheaper. $\endgroup$ – badbayesian Dec 21 '15 at 14:57

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.