I was using one class SVM, implemented in scikit-learn, for my research work. But I have no good understanding of this.

Can anyone please give a simple, good explanation of one class SVM?


The problem addressed by One Class SVM, as the documentation says, is novelty detection. The original paper describing how to use SVMs for this task is "Support Vector Method for Novelty Detection".

The idea of novelty detection is to detect rare events, i.e. events that happen rarely, and hence, of which you have very little samples. The problem is then, that the usual way of training a classifier will not work.

So how do you decide what a novel pattern is?. Many approaches are based on the estimation of the density of probability for the data. Novelty corresponds to those samples where the density of probability is "very low". How low depends on the application.

Now, SVMs are max-margin methods, i.e. they do not model a probability distribution. Here the idea is to find a function that is positive for regions with high density of points, and negative for small densities.

The gritty details are given in the paper. ;) If you really intend to go through the paper, make sure that you first understand the settings of the basic SVM algorithm for classification. It will make much easier to understand the bounds and the motivation the algorithm.

  • $\begingroup$ Is the paper you linked to the original paper for one-class SVM's? $\endgroup$ – user3731622 Sep 27 at 16:10
  • $\begingroup$ yes, but why should that matter? $\endgroup$ – jpmuc Sep 27 at 17:55
  • $\begingroup$ I was just trying to track down the origins of one-class SVM. $\endgroup$ – user3731622 Sep 27 at 18:48

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.