1
$\begingroup$

Here is Fitting the t-Distribution by Maximum Likelihood t-method in book Statistics and Data Analysis for Financial Engineering with R examples page 113 and 168.

But I cannot understand

For the univariate case (first picture):

  1. How does the fitting work? Is it the method called expectation–maximization (EM) algorithm?

  2. And I understood as first we obtain $\mu,\sigma$ by fitting, then use MLE to obtain the parameter $\nu,$ is it correct?

For the multivariate case (second picture):

  1. Does that mean we first compute $\nu,$ then use MLE to compute $\mu$ and $\Lambda?$

  2. If so, then how could we compute $\nu$ with unknown $\mu$ and $\Lambda?$ And the logic totally reverses compared with the univariate case.

  3. I think the parameter estimation should be consistent between univariate and multivariate cases and I must have a big misunderstanding.

enter image description here

enter image description here

$\endgroup$
0

1 Answer 1

0
$\begingroup$

This is just a partial answer in that it addresses the univariate questions.

The method in that textbook tells you to maximize the log of the likelihood so it is using maximum likelihood (using odd notation in my opinion as it seems to assume unjustifiably that $\mu$ and $\sigma$ are known and that it displays those two parameters that have nothing to do with a "standardized" t-distribution - maybe that's a typo in the book).

One can also use the method of moments where one equates the sample moments to the associated expected moments. For this distribution one could use $E(X)=\mu$, $Var(X)=\nu \sigma^2/(\nu-2)$ (for $\nu>2$), and $E[(X-\mu)^4]=\frac{3 \nu ^2 \sigma ^4}{(\nu -4) (\nu -2)}$ (for $\nu>2$). If $\bar{x}$ is the sample mean, $s^2$ is the sample variance, and $m_4$ is the sample fourth central moment, then $\hat{\mu}=\bar{x}$, $\hat{\sigma}^2=\frac{m_4 s^2}{2 m_4-3 s^4}$, and $\hat{\nu}=\frac{2 \left(2 m_4-3 s^4\right)}{m_4-3 s^4}$. (The distribution is symmetric about $\mu$ so the third central moment doesn't help us estimate the parameters. In other words, the expected third central moment is zero and therefore not dependent on any of the parameters.)

These values can be used as starting values for an iterative maximum likelihood procedure (although I think that $\bar{x}$ will be the maximum likelihood estimator for $\mu$).

$\endgroup$
8
  • 2
    $\begingroup$ The MLE for $\mu$ won't be $\bar{X}$. $\endgroup$
    – Glen_b
    Aug 7, 2019 at 22:35
  • $\begingroup$ @Glen_b Uh, oh. Good thing I said "I think" (even though I apparently wasn't thinking). $\endgroup$
    – JimB
    Aug 7, 2019 at 22:45
  • 1
    $\begingroup$ No problem. The heavier tail on the t makes sample means inefficient. $\endgroup$
    – Glen_b
    Aug 7, 2019 at 22:47
  • 1
    $\begingroup$ I really don't think so, but I am happy to be convinced otherwise. Can you say what led you to this conclusion (for either one or the other of those two)? $\endgroup$
    – Glen_b
    Aug 7, 2019 at 23:06
  • 1
    $\begingroup$ Yes, the partial derivative of the log-likelihood would be zero (missed the last part of your comment before; just saw the comment about it being a max). For the second case when $\nu=1$ (or even just sufficiently small) and the two x-values are not close together, $\bar{x}$ is a local minimum in the $\mu$-direction. $\endgroup$
    – Glen_b
    Aug 7, 2019 at 23:19

Not the answer you're looking for? Browse other questions tagged or ask your own question.