Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

Given the pdf $f(x) = \sum_i \omega_i \mathcal{N}(x; \mu_i, C_i )$ of a gaussian mixture density, where the $i$-th component has mean $\mu_i$ and covariance matrix $C_i$ and the weights $\omega_i$ sum to 1, is there a formula to compute the moments and central moments of this density from the given $\omega_i$'s, $\mu_i$'s and $C_i$'s?

share|improve this question

1 Answer

up vote 3 down vote accepted

It is simple because of linearity of integration (exchange order of integration and expectation). $\mu=\omega_1 \mu_1 +\omega_2\mu_2 +\dots+\omega_k \mu_k$ The same is true for higher order moments and central moments with the $\mu_i$s replaced by the variances for variances etc. Now since each $\mu_i$ and $C_i$ determines the higher order moments by normality the third and fourth moments for example can all be expressed as functions of them.

Anything else you want to know about finite mixtures can be found in these books(I include the EM Algorithm book because that is the method most often used to get the MLEs for the parameters:

Finite Mixture Models

The EM Algorithm and Extensions

Nonparametric Statistics and Mixture Models: A Festschrift in Honor of Thomas P Hettmansperger

Medical Applications of Finite Mixture Models

Mixture Models

share|improve this answer
I am a bit unclear on the variance of $f(x)$. Intuitively I would have thought that for a mixture model, the variance would also depend on the means, and not just be $C=w_1C1+w_2C_2+\dots+w_kC_k$ as your answer implies. There is a related answer on the math SE which is somewhat contradicting. – Jakob Feb 15 at 20:39

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.