1
$\begingroup$

As I can read from the source code of scikit-learn, the stopping criteria for the iterative algorithm of Expectation Maximization (in my case applied to fitting Gaussian mixture models) is to put a threshold on the changes in the log-likelihood.

I can easily imagine that is way simpler to take some sample from the dataset and estimate the log-likelihood than putting a distance on covariance matrices and the centroids, to mimic what people do in k-means.

My question is: have you seen in any paper/software that proposed a threshold on the covariance matrices and the centroids of the Gaussian? Would this be silly to consider or can make sense sometimes?

Thanks!

$\endgroup$
  • 1
    $\begingroup$ In essence, it should be equivalent, as the log likelihood is continuous in the parameters (in most practical points). However, you can't use the exact same threshold. The scaling of the threshold could be dependent on the dimension (and maybe even the true parameters) $\endgroup$ – tmrlvi Feb 5 at 23:43

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.