3
$\begingroup$

So I had this question on a test and still can't do much about it, it's like this:

"Given a random sample with a size of 2, from a population with density:

$$f(x) = \frac{2}{\alpha^2}(\alpha-x)I_{(0,\alpha)}(x)$$

We also observed that $x_1 = 1.2$ and $x_2 = 4.4$. Find a MLE for $\alpha$."

So, calculating the likelihood function:

$$ L(x,\alpha)=\prod_{1}^{2}\frac{2}{\alpha^2}(\alpha-x_i)I_{(0,\alpha)}(x_i) $$

$$ L(x,\alpha) = \frac{4}{\alpha^4}(\alpha-x_1)(\alpha-x_2)I_{(\alpha \geq \max(x_1,x_2))}(\alpha) $$

Given that $\frac{4}{\alpha^4}(\alpha-x_1)(\alpha-x_2)$ is not really a crescent or decrescent function for all $\alpha$, I'm really not sure what to do next!

Checking for $\alpha \geq 4.4$ only, I got that the point the function stops increasing and starts decreasing again is at $\approx 6.861$ (replacing the values in the function, and using desmos to graph it), so I thought this would be the MLE, but my lecturer said that the right answer would be the $\max(x_1,x_2)$, so I'm really lost.

$\endgroup$
4
  • 3
    $\begingroup$ I think your lecturer is wrong... As you observe, the Likelihood function is maximized at close to $6.86$. For $n=2$ you can take the derivative and set it equal to $0$ to find the optima. Throw out any points which are not in $(\alpha, \infty)$. This will give you a precise form for the MLE. $\endgroup$
    – knrumsey
    Commented Dec 9, 2017 at 0:06
  • $\begingroup$ Thanks for that, it's was actually way more simple than I thought... I always had some problems with problems involving parameters in the indicator function, but now I'm pretty sure I'm better prepared to approach them. $\endgroup$
    – Tricolor
    Commented Dec 9, 2017 at 1:24
  • 1
    $\begingroup$ @DilipSarwate Hmm... have you looked at this particular density function closely? I don't think it's that simple in general for this problem. Do you see an error in the accepted answer? It agrees with my previous comment. $\endgroup$
    – knrumsey
    Commented May 8, 2020 at 4:07
  • $\begingroup$ @knrumsey My apologies. I was remembering (and presumably the OP's lecturer was remembering) the case of $\mathcal U[0,\alpha]$ random variables where the likelihood function jumps from $0$ to $\alpha^{-n}$ for $\alpha \in [x_\max,\infty)$, thus making the MLE $x_\max$, and applying this to the pdf here without thinking about the difference in pdfs. I have deleted my incorrect comment. $\endgroup$ Commented May 9, 2020 at 16:10

1 Answer 1

1
$\begingroup$

I take it $I_{0, \alpha}(x)$ is the indicator function that takes 1 if $x \in (0, \alpha)$ and $0$ otherwise.

$$L(x,\alpha)=\prod_{1}^{2}\frac{2}{\alpha^2}(\alpha-x_i)I_{(0,\alpha)}(x_i)$$

I take the log because: (1) maximizing the likelihood is the same as maximizing the log of the likelihood since log is a monotonic increasing transformation (2) log makes multiplication sum and that's nicer.

$$\log L(x,\alpha)=\sum_i \left[ \log 2 - 2 \log \alpha + \log (\alpha - x_i) + \log I_{(0,\alpha)}(x_i)\right] $$

Our maximum log likelihood problem is \begin{equation} \begin{array}{*2{>{\displaystyle}r}} \mbox{maximize (over $\alpha$)} & \sum_i \left[ \log 2 - 2 \log \alpha + \log (\alpha - x_i) + \log I_{(0,\alpha)}(x_i)\right] \end{array} \end{equation}

We immediately can see that if $x_i > \alpha$ for any $x_i$ that we have a $\log 0 = -\infty$ for our objective (which kinda is bad if you're trying to maximize). So we know we want $\alpha \geq \max(x_1, x_2)$. An equivalent optimizaiton problem is.

\begin{equation} \begin{array}{*2{>{\displaystyle}r}} \mbox{maximize (over $\alpha$)} & \sum_i \left[ - 2 \log \alpha + \log (\alpha - x_i) \right] \\ \mbox{subject to} & \alpha \geq \max(x_1, x_2) \end{array} \end{equation}

This isn't a thrilling maximization problem because the objective isn't inherently concave. The first order conditions won't be sufficient for a maximum. The first order (necessary but not sufficient) condition though (ignoring the constraint) is:

$$ - \frac{4}{\alpha} + \frac{1}{\alpha - 1.2} + \frac{1}{\alpha - 4.4} = 0 $$ A bunch of algebra leads to the quadratic equation: $$ -2a^2 + \frac{84}{5}a - \frac{528}{25} = 0$$

You get roots $1.5392$ and $6.8608$, and $6.860826939130014$ looks like a maximum. Graphing the original likelihood function:

enter image description here

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.