Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.

For a multilabel dataset, i would like to find the number of clusters involved in it. The below example gives more details about the problem:

Label_A: feature values
Label_B: feature values
Label_A, Label_C: feature values 
Label_C: feature values ... etc

We have say $n$ datarecord. Label field may have single label/multilabel(as in the case of record 3).

I would like to determine the number of cluster involved in the data. Assuming number of label as the number of cluster results in bad accuracy. This is because there may be case where single label can have multiple cluster. In this case, if we can find more cluster and assign two or more cluster to same label, we can increase the accuracy.

Hence, how do you find the number of cluster present in the multilabel data?

share|improve this question
2  
see this related question on stopping criteria for cluster analysis: stats.stackexchange.com/questions/2597/… – Jeromy Anglim Apr 28 '11 at 15:08
I've answered a similar Q with half a dozen methods (using R) over here: stackoverflow.com/a/15376462/1036500 – Ben May 13 at 4:54

1 Answer

up vote 2 down vote accepted

You can convert the labels into features indicating if the label is present or not. After that you can use various clustering algorithms and their corresponding methods to find out the number of clusters.

EDIT: I understood that your difficulty was handling the multiple labels and I suggested a solution for that. Your question did not mention that you wanted to use the k-means algorithm. The number of k-means clusters question has been answered here: How to define number of clusters in K-means clustering?. For hierarchical clustering the answer is here: Where to cut a dendrogram?. But there are many other clustering methods available: Choosing clustering method.

share|improve this answer
Could you please elaborate on your answer. I couldnt get your point of use various clustering algorithms and their corresponding methods to find out the number of clusters. If I choose to run k-means on the new dataset, i have to provide k as an input. My Q is what value of k of best for the original dataset. – Learner Apr 28 '11 at 15:01
@Learner I've edited my post to reply to your comment. – GaBorgulya Apr 28 '11 at 19:13

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.