1
$\begingroup$

Assume $μ1$ and $μ2$ are the two means and the standard deviation is $σ$ for two normal distribution.

The probability of x in the mixture of these two normal distributions is

$$ p(x)=0.5N(x;μ1,σ)+0.5N(x;μ2,σ) $$

How can I prove the second derivative is strictly less than zero for $|μ1−μ2|<2σ$

Really appreciate any thoughts.

$\endgroup$
13
  • 1
    $\begingroup$ Have you tried calculating the derivatives of the mixture density? (The answer to the first one does not require any calculation--it follows directly from the symmetries of the distributions and the differentiability of their densities--but the answer to the second one does appear to need some calculation.) $\endgroup$
    – whuber
    Commented Mar 8, 2018 at 13:52
  • $\begingroup$ And what, then, prevents you from drawing the desired conclusions? What expression did you get for the second derivative? $\endgroup$
    – whuber
    Commented Mar 9, 2018 at 14:26
  • $\begingroup$ Right now, I have an inequality function I can not solve. For x > $\frac{\mu1+\mu2}{2}$, $((x-\mu1)^2 - \sigma^2)\exp^{\frac{-(x-\mu1)^2}{2\sigma^2}} + ((x-\mu2)^2 - \sigma^2)\exp^{\frac{-(x-\mu1)^2}{2\sigma^2}} < 0$ $\endgroup$
    – YungChun
    Commented Mar 10, 2018 at 1:12
  • $\begingroup$ Can you give some tips to solve a function like this? Thanks! $\endgroup$
    – YungChun
    Commented Mar 10, 2018 at 1:16
  • $\begingroup$ Because the exponential is positive, you may divide both sides by it, leaving a quadratic inequality in $x$. Its solution is elementary. $\endgroup$
    – whuber
    Commented Mar 10, 2018 at 16:55

1 Answer 1

1
$\begingroup$

Thanks for the help from @whuber. Here is the answer to my own question. The original statement is not true. It should be rephrased to this,

$$ For\ |\mu2-\mu1| < 2\sigma\\ p''(x) < 0, if \begin{cases}\sigma < x < (\mu2 - \mu1) + \sigma\\-\sigma < x < (\mu2 - \mu1) - \sigma\end{cases} $$

Proof:

After some calculation, the second derivative is

$$ p''(x) = \frac{-1}{2\sqrt{2\pi}\sigma^3}[(1 - \frac{(x - \mu1)^2}{\sigma^2}) \exp^{\frac{-(x - \mu1)^2}{2\sigma^2}} + (1 - \frac{(x - \mu2)^2}{\sigma^2}) \exp^{\frac{-(x - \mu2)^2}{2\sigma^2}}] $$

Set $y = \frac{1}{\sigma}(x - \frac{\mu1 + \mu2}{2})$

$$ p''(y) = \frac{-1}{2\sqrt{2\pi}\sigma^3}[(1 - (y + (\frac{\mu2 - \mu1}{2\sigma}))^2) \exp^{\frac{-1}{2}(y + \frac{\mu2 - \mu1}{2\sigma})^2} + (1 - (y - (\frac{\mu2 - \mu1}{2\sigma}))^2) \exp^{\frac{-1}{2}(y - (\frac{\mu2 - \mu1}{2\sigma}))^2}] $$

By removing the constant, then the objective function is

$$ ((y + (\frac{\mu2 - \mu1}{2\sigma}))^2 - 1) \exp^{-y(\frac{\mu2 - \mu1}{\sigma})} + ((y - (\frac{\mu2 - \mu1}{2\sigma}))^2 - 1) < 0 $$

We can organize this function into

$$ \exp^{-y(\frac{\mu2 - \mu1}{\sigma})} < \frac{(1 - (y - (\frac{\mu2 - \mu1}{2\sigma}))^2)}{((y + (\frac{\mu2 - \mu1}{2\sigma}))^2 - 1)} $$

Because the exponential function must be positive, we should try to prove that

$$ (1 - (y - (\frac{\mu2 - \mu1}{2\sigma}))^2)((y + (\frac{\mu2 - \mu1}{2\sigma}))^2 - 1) > 0 $$

Because the 4 roots in this function are

$$ y = \frac{\mu2 - \mu1}{2\sigma}\pm1, -\frac{\mu2 - \mu1}{2\sigma}\pm1 $$

Finally, we can find the interval of y to make this function larger than 0

$$ \begin{alignedat}{2} -\frac{\mu2 - \mu1}{2\sigma} - 1 < y < \frac{\mu2 - \mu1}{2\sigma} - 1\\ 1 - \frac{\mu2 - \mu1}{2\sigma} < y < \frac{\mu2 - \mu1}{2\sigma} + 1 \end{alignedat} $$

After substituing y with $\frac{1}{\sigma}(x - \frac{\mu1 + \mu2}{2})$, we can get

$$ \begin{alignedat}{2} \mu1 - \sigma < x < \mu2 - \sigma\\ \sigma - \mu1 < x < \mu2 + \sigma\ \end{alignedat} $$

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.