Skip to main content
2 of 6
edited body
KOE
  • 4.6k
  • 1
  • 18
  • 40

Let me give an example of a sequence of random variable converging to zero in probability but with infinite variance. In essence, an estimator is just a random variable so with a little abstraction, you can see that convergence in probability to a constant does not imply finite variance.

Consider the random variable $\xi_n(x):=\chi_{[0,1/n]}(x)x^{-1/2}$ on $[0,1]$ where the probability measure considered is the Lebesgue measure. Clearly, $P(\xi_n(x)>0)=1/n\to0$ but $$\int\xi_n^2dP=\int_{0}^{1/n}x^{-1}dx=-x^{-2}\mid _{0}^{1/n}=\infty,$$ for all $n$ so its variance does not go to zero.

Now, just make up an estimator where as your sample grows you estimate the true value $\mu=0$ by a draw of $\xi_n$. Note that this estimator is not unbiased for 0.

KOE
  • 4.6k
  • 1
  • 18
  • 40