If we group examples with and without class labels using clustering techniques by treating the class as an ordinary nominal attribute, the resulting clusters can then be used for classifying test instances by assigning the most frequent class in each cluster to test instances that fall into that cluster. Why is this method is less accurate than methods that are specifically developed for classification?
$\begingroup$
$\endgroup$
0
Add a comment
|
2 Answers
$\begingroup$
$\endgroup$
0
Because by assigning class labels based on clustering you are basically assuming your clustering constitutes a perfect classification. Whatever you do after that is trying to model the clusters, not the classes.
In fact, since you specifically say "by assigning the most frequent class in each cluster" you already know this is a bad approach as your clusters are NOT all in a single class. Using this approach you contaminate the pure information about your classes with guesses based on the structure within the data (or, rather, the apparent structure captured by your clustering algorithm).
answered Jan 14, 2014 at 17:42
$\begingroup$
$\endgroup$
2
Well actually, this isn't always true - supervised methods are not always better than unsupervised methods. This is a variant of the no free lunch theorem, denying our one-fits-all preferences for methods.
Recent results in deep learning involve effectively predicting the data and smoothing the model, and have lead to unsupervised models (clusters essentially) that beat all the supervised algorithms hands down. This applies particularly to (spoken and optical) character recognition and other language related problems.
What it comes down to is whether you believe your model more or less than the gold standard.
For example with language learning, nobody really has any idea what is going on in people's heads so a good model for unsupervised learning may be giving correct answers and the arbitrary answers of gold standards may be wrong. In some specific cases, I have documented gold standards as being wrong 90% of the time (not overall but for these specific cases that they always get wrong because the creators cheated and used a model + learning to produce the gold standard, or in some cases multiple models, or even the results generated by the first batch of entries to a competition).
answered Mar 29, 2016 at 10:36
-
1$\begingroup$ To say that undersupervised methods can beat supervised methods hands down in a wide variety of cases is either not understanding the problem or is assuming there are no smooth relationships between $Y$ and continuous $X$ and a high signal:noise ratio. $\endgroup$ Mar 29, 2016 at 11:39
-
$\begingroup$ @Frank: As noted (in the paragraph you quote), this applies particularly to language. Parents don't teach children language in a supervised way, but children learn it almost entirely unsupervised. If you get the right biases (e.g. the same ones children use) then expect unsupervised learning to do better than supervised learning (particularly when based on ill-motivated or poorly labelled taggings). I don't discuss assumptions or biases, but they are important, though the point is that those that assume supervised is always better are making assumptions. $\endgroup$ Apr 24, 2017 at 6:35