What is it called when, in a classification task, it is acceptable that some data-points do not receive a label? And what classifiers are suitable?
I have a dataset with a two valued target variable. After manually tweaking the results of the CN2 rule-induction algoritm i get:
- A few short rules that select sizable parts of the data (ie do not overfit)
- These rules are meaningful to a domain expert
These rules accurately label data-points belonging in each group, but about 35% of the data-points are not labelled at all. The distribution of classes in the unlabelled data is the same as in the orginal dataset. In other words, the probability of falling in either group, for the unlabeled data-points, is the same as the a-priori probability.
These are acceptable results, because the number of false positives is low for both labels. In real life this kind of classification is common, think of a doctor who runs tests to exclude certain conditions.
It also is the best classification i have been able to come up with for this data-set.
My questions are:
- Is there a name for this kind of classification?
- What classifiers can do this out of the box? Here i manually tweaked rules generated bij CN2.