8
$\begingroup$

I am working with the twostep cluster process in SPSS Modeler (Clementine) and trying to get a sense for the distance function used. It is a log-likelihood function (as stated in docs) but I am unsure for even the continuous variables (the function handles continuous and nominal variable) how this is a log likelihood (it is missing most of the elements of a Gaussian). Below is a screen shot of the documentation describing the distance formula.

Has anyone seen the derivation of this distance function?

enter image description here

$\endgroup$
0

1 Answer 1

3
$\begingroup$

SPSS two step cluster model algorithm is described in more detail in:

Chiu, Tom, DongPing Fang, John Chen, Yao Wang, and Christopher Jeris (2001), "A robust and scalable clustering algorithm for mixed type attributes in large database environment," Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining KDD '01.

More generally, if you look at the model-based clustering literature and the latent class literature you should get an understanding of how continuous and nominal variables enter into the likelihood. The various documentations for Latent Gold are pretty useful and available on the web.

Most of the published literature uses a slightly different model to that in SPSS. The difference relates to the treatment of the class sizes (the priors). The SPSS modification, which is a simplification, seems to be aimed at reducing computing costs (as opposed to increasing rigor).

$\endgroup$
1
  • $\begingroup$ how continuous and nominal variables enter into the likelihood + The SPSS modification, which is a simplification Tim, may I ask you to give (or to send me directly to) just few more general or primordial or better formulas of the LL on which we may base the distance, with some comments? Thank you! $\endgroup$
    – ttnphns
    Jul 2, 2016 at 15:07

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.