8
$\begingroup$

I am struggling to understand the following result from Casella and Berger about sufficiency and completeness for exponential families:

Let $X_{1},X_{2},...,X_{n}$ be iid observations from an exponential family with PDF or PMF of the form$$f(x|\theta)=h(x)c(\theta)exp\left ( \sum_{j=1}^{k} w(\theta_j)t_j(x) \right )$$where $\theta=(\theta_1,...,\theta_k)$, then $$T(X)=\left ( \sum_{i=1}^{n}t_1(X_i),\sum_{i=1}^{n}t_2(X_i),....,\sum_{i=1}^{n}t_k(X_i) \right )$$is complete as long as the parameter space $\Theta$ contains an open set in $R^k$.

Can someone explain the above definition in simple language? I can apply it in exponential family distributions like gamma, Binomial &tc. But I want to understand what is the significance of this line as long as the parameter space $\Theta$ contains an open set in $R^k$.

$\endgroup$
3
  • $\begingroup$ Without knowing anything about this particular problem my guess is that they need the parameter space contain an open set because they want to take derivatives of functions w.r.t. $\Theta$. See Thm. 3.4.2 (at least here: fsalamri.files.wordpress.com/2015/02/…). $\endgroup$ Commented Jan 10, 2018 at 10:08
  • 2
    $\begingroup$ @FabianWerner - No, it's the "Open Set Condition" and is sufficient for completeness of the sufficient statistic. You like to have completeness because completeness relates to certain properties of the distribution of the sufficient statistics across all $\theta \in \Theta$. It's more related to the ability to integrate rather than to differentiate! $\endgroup$
    – jbowman
    Commented Jan 10, 2018 at 18:02
  • 1
    $\begingroup$ This is not a definition rather a sufficient condition (lemma). $\endgroup$
    – Xi'an
    Commented Nov 27, 2019 at 9:59

1 Answer 1

7
$\begingroup$

The significance of that line is that if you can verify that the parameter space contains an open set in $R^k$, you know, without any further work, that the sufficient statistics $T(X)$ are also complete. That is usually a lot easier to do than trying to apply the definition of completeness directly.

Completeness is a nice property, but not of overwhelming importance. One consequence is that if you have a complete sufficient statistic, you can construct a UMVUE estimator based upon it (Lehmann-Scheffe). See also: What are complete sufficient statistics?.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.