# Maximum likelihood estimator that is not a function of a sufficient statistic

I always read that every maximum likelihood estimator has to be a function of any sufficient statistic. The idea is that, if we are dealing with a random variable $X$ with mass or density function $f(x\mid\theta)$, and $T$ is a sufficient statistic for $\theta$, then by the factorization theorem $f(\vec{x}\mid\theta)=g(T(\vec{x}),\theta)h(\vec{x})$, so maximizing $f(\vec{x}\mid\theta)$ on $\theta$ means maximizing $g(T(\vec{x})\mid\theta)$ on $\theta$, therefore every maximum likelihood estimator for $\theta$ must be a function of $T(\vec{x})$.

However, I have the following counterexample? for this result:

Let $X\sim\text{Unif}(\theta-1/2,\theta+1/2)$. The likelihood function if $L(\theta\mid\vec{x})=1_{[x_{(n)}-1/2,x_{(1)}+1/2]}$, where $x_{(1)}$ and $x_{(n)}$ are, respectively, the minimum and the maximum of our sample $\vec{x}$ of size $n$. Then, any $\hat{\theta}$ with $x_{(n)}-1/2\leq\hat{\theta}\leq x_{(1)}+1/2$ is a maximum likelihood estimator. Also, note that $(X_{(1)},X_{(n)})$ is a sufficient statistic. Now let $$\hat{\theta}=x_{(n)}-1/2+\frac{|x_j|}{1+|x_j|}(x_{(1)}-x_{(n)}+1),$$ where $x_j\neq x_{(1)}$ and $x_j\neq x_{(n)}$. This $\hat{\theta}$ is a maximum likelihood estimator for $\theta$, but is not a function of $(x_{(1)},x_{(n)})$.

What is wrong?

• I'm sorry, but why is this not a function of $(x_{(1)},x_{(n)})$? Your mathematical expression clearly says it is a function! Dec 28, 2016 at 18:07
• It seems that your example deals with the uniqueness of the MLE and not its dependence on the sufficient statistic. Dec 28, 2016 at 18:14
• In English "the" means 1 "a" means possibly more than one. This is technically not in the "proof" but is in the problem statement (proposition). Dec 28, 2016 at 20:00
• I would not be inclined to answer this question unless some authoritative source of the incorrect assertions on which it relies can be cited. In particular, the introductory claim "every maximum likelihood estimator has to be a function of any sufficient statistic" is not true. What is true is that every ML estimator, if unique, must be a function of the sufficient statistics. This is an immediate consequence of the definitions of the MLE and sufficient statistic. (See Kendall & Stuart 5th Ed. Vol II section 18.4.)
– whuber
Dec 29, 2016 at 15:50
• You erred at the point you wrote "therefore". Your conclusion does not follow unless the maximum value depends uniquely on $T$, for otherwise you are free to select $\hat\theta$ in arbitrary ways--exactly as you do in your example.
– whuber
Dec 29, 2016 at 19:02

If $T$ is a sufficient statistic for $\theta$ and a unique MLE of $\hat{\theta}$ exists, then $\hat{\theta}$ must be a function of $T$. If any MLE exists, then an MLE $\hat{\theta}$ can be chosen to be a function of $T$.