# Sufficiency in Lehmann Scheffe

We are wondering what sufficiency in the Lehmann Scheffe Theorem is needed for. Our reasoning was:

1. If an unbiased estimator is uncorrelated with all unbiased estimators of 0, it is UMVUE
2. If the estimator is from a complete family, it is uncorrelated with all unbiased estimators of 0
3. Therefore an unbiased estimator from a complete family is UMVUE
4. UMVUE is unique

So what exactly is sufficiency needed for? Why is completeness not enough?

Would be nice if anyone could point out the flaws in our reasoning and explain!

-
How did you arrive at your (2)? Can you think of an example of an unbiased statistic that is complete but not sufficient? (Hint: Bernoulli.) What does sufficiency buy you, particularly when evaluating quadratic risk of unbiased estimators? –  cardinal Sep 20 '12 at 19:01
Our reasoning for (2) was: If we are in a complete family, all unbiased estimators of 0 are 0 with probability 1. Every statistic is uncorrelated with 0, so in particular our estimator is. Our problem might be, that the "we are in a complete family" is a little vague. We only assume that the estimator is from a complete family. Can there be another estimator from a non-complete family then? We have no idea! –  user1587692 Sep 20 '12 at 19:39
It seems you are confused about the notions of unbiasedness and also probably completeness. If a statistic is complete with respect to a parameter $\theta$ that does not mean it is uncorrelated with every unbiased statistic of zero (of the whole data). Try constructing a counterexample from a sample of $\mathrm{Ber}(p)$. Going through this exercise should solidify the concepts, I think. –  cardinal Sep 20 '12 at 19:55
It seems like we are using different definitions of completeness. What do you mean by a statistic being complete for a parameter? To us, only a family of distributions can be complete (not for a parameter). In Casella&Berger it says: If a family of pdfs or pmfs f(x|theta) has the property that there are no unbiased estimators of 0 (other than 0 itself) ... Recall that the property of completeness guarantees such a situation. (p. 346) Maybe you can clarify for us, which family should be complete here. Of the statistic? Of the sample? Or how is it meant? Thanks! –  user1587692 Sep 20 '12 at 20:27

The problem is (2), as others have noted. Let $X_1, ..., X_n$ be iid normal with mean $\theta$ and variance $1$. The statistic $T(X_1, ..., X_n) = X_1$ is complete, because the normal family is complete. But it is not uncorrelated with all unbiased estimators of $0$; take $\hat 0 = X_1 - X_2$. In constructing unbiased estimators of $0$ we are allowed to use the entire data, whereas completeness is only a property of the marginal distribution of $T(X_1, ..., X_n)$.

The logic in Casella and Berger is this: if $T = T(X_1, ..., X_n)$ is sufficient then it suffices to only consider the distribution of $T$ when looking for unbiased estimators, by Rao-Blackwell. This is what sufficiency is giving you - it allows you to ignore everything except $T$. So it suffices to show, if $g(T)$ is unbiased for $\theta$, that $g(T)$ is uncorrelated with every unbiased estimate of $0$, $\hat 0(T)$ [note: because of sufficiency, we have reduced the problem of showing uncorrelatedness with every estimator of $0$ to only have to show it for estimators that depend only on $T$]. But if $T$ is complete then there are no unbiased estimators $\hat 0(T)$ other than $0$ which $g(T)$ is uncorrelated with, so we are done. Of course, now that we've established that $g(T)$ is the UMVUE, it follows a posteriori that $g(T)$ is uncorrelated with all unbiased estimators of $0$, $\hat 0(X_1, ..., X_n)$, that depend on the entire sample.

-
(+1) Good answer. –  cardinal Sep 20 '12 at 22:53
thanks a lot, that's exactly what we were looking for! –  user1587692 Sep 21 '12 at 14:23
If your Uniformly Minimum Variance Unbiased Estimator $U$ of $\theta$ were not a function of a sufficient statistic $S$ alone (a.s.), then, by the Rao-Blackwell Theorem, the random variable $V=\textrm{E}_\theta[U\mid S]$ would be an unbiased estimator of $\theta$ that has variance uniformly smaller than $U$, which contradicts the fact that $U$ is an Uniformly Minimum Variance Unbiased Estimator of $\theta$. A Lehmann-Scheffé style result without the sufficiency assumption would leave that window open.