I know there is a series of regression diagnostics procedures (correlation, beta, residual, etc.) before, during, and after regression analysis. But, is there any common procedure to follow for cluster analysis (like, Ward)? What are the R commands? Thanks!


1 Answer 1


Correlation can cause problems with many clustering algorithms by giving extra weight on these attributes. For k-means it seems to be a best practise to whiten the data first, for example.

However, there exist correlation clustering algorithms that are meant to process data containing multiple correlations, and cluster objects based on the correlations they exhibit.

  • 3
    $\begingroup$ A data set with no global correlations (i.e. $Cov(X,Y)$) may still contain clusters, and may even contain correlated subsets (which is the point of doing correlation clustering, finding subsets that have different correlations). $\endgroup$ Commented Nov 24, 2013 at 12:43
  • 3
    $\begingroup$ As $k$-means is closely related to PCA, a natural way to whiten/remove the correlations would be running the clustering on the PC scores. $\endgroup$ Commented Nov 24, 2013 at 14:05
  • $\begingroup$ What are these "correlation clustering algorithms"? Can you give an example? $\endgroup$ Commented Jul 21, 2015 at 15:57
  • $\begingroup$ ORCLUS for example. $\endgroup$ Commented Jul 21, 2015 at 20:24

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.