6
$\begingroup$

I would like to know how I can use clustering methods in R (in this case, Kmeans) if I have an "unkind" input matrix (I get this error log:

The TSS matrix is indefinite. There must be too many missing values. The index cannot be calculated.)

I could see that I might get this error if my matrix produces negative eigenvalues (like, here: https://stackoverflow.com/questions/20669596/nbclust-package-error), but what I'm missing is the "next step" part. I could see a suggestion was to "go back to the Data", but what should I do then? Is there any transformation or something that might help? (I'm pretty new to R and clustering in general...)

The Data I'm using are the result of a survey (which I briefly transformed and scaled via the scale function in R) so I was wondering if there were some algorithms or methods I could use in order to go on with my analysis (from literature I couldn't find great help). Or, if you think this is unfixable or simply non the best solution, do you have any other suggestion for clustering my data? What I'm willing to do is to identify some clusters of possible users/customers of some services, depending on their usual habits (e.g.: if they use many social networks they will be more likely to use chat/whatsapp/app to ask for bank account information - I have both the information of their social network usage and their ways of communicating with a "bank assistant").

The Dataset consists of 994 rows and 103 columns. Don't know if it may help, but the code is simply this:

Data2<- read.csv(...)
bDataScale <- scale(Data2)
nc <- NbClust(bDataScale, min.nc=2, max.nc=993, method="kmeans")

And I get:

Error in NbClust(bDataScale, min.nc = 2, max.nc = 993, method = "kmeans") : The TSS matrix is indefinite. There must be too many missing values. The index cannot be calculated.

Thank you in advance for your help or any corrections,

Julia

P.S.: as it would be logical to expect, I get the same error also with the unscaled matrix.

Improve this question
$\endgroup$

1 Answer 1

Reset to default
1
$\begingroup$

The answer you linked seems to suggest that negative eigenvalues tend to crop up with larger values of max.nc. So maybe try reducing that to something reasonable? I don't know how you'd go about interpreting 993 clusters in any case.

Improve this answer
$\endgroup$
2
  • $\begingroup$ Yes, in fact in the first attempts I tried using less clusters (I tried putting max.cn = 5 and 15) though it didn't work properly at any case. What I did was to apply the "simple" kmeans r-method deciding by myself the number of clusters. Still... Not a satisfactory result since it is a little bit messy. Thanks anyway. $\endgroup$
    – Julia_Engl
    Apr 6, 2016 at 12:23
  • $\begingroup$ If you can motivate your choice of k by gap statistic or silhouette plots, I think that'd be fine too $\endgroup$
    – fanli
    Apr 6, 2016 at 15:10

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.