# Is it a known phenomenon for the variance of a component (GMM) to increase without stopping?

I know it can happen for it to decrease dramatically as it overfits on a single datapoint. But I've never read about a component "taking everything over". See the following images (circles are stddevs). Could this be (relatively) normal behaviour?

edit: For some reason changing my gaussian function made the behaviour sane, note both return the same output for given inputs:

iter 300!

• How are you fitting the mixture model.. is it EM? What does the circles stand for... a contour plot of sort? – Suren Jan 23 '18 at 0:33
• Yes EM. Contour is stddev of the component (root of variance, covar matrix is diagonal). – Nimitz14 Jan 23 '18 at 9:11
• It is very much possible to end up with smaller size cluster, if you are fitting an incorrect model, say larger number of clusters. By looking at this data, even though it is 2D, it is difficult to say how many clusters would be appropriate or what type of mixture model you should fit. I'd recommend trying something like mclust software to see what it does, and then compare that with outcomes of your algorithm. – Suren Jan 24 '18 at 0:27