2
$\begingroup$

For a given set of features (say with dimension a) and for a given set of labels (say m labels), how to relate the given features with the weight vector of the SVM in general? Will it be equal to product of the two dimensions always, or is it required to find the dimensions of the both the feature space and the label space and then find the resultant dimension of the weight vector?

$\endgroup$
3
$\begingroup$

Note that even if you are implementing multi-class SVM, the one-vs-all strategy is usually applied (or you can use other strategies to achieve the multi-classifier effect), since SVM is binary classifier.

The dimension of weight vector is the same as feature dimension. So if you are applying the linear SVM, the weight vector dimension is equal to the input space dimension. For other kernels, original data space is transformed into another high-dimensional space, specifically, if you are applying the RBF kernel, the weight vector dimension can be viewed as infinite.

You can search any SVM tutorials online on the topic of the basic binary SVM classifier along with the extended version (such as multi-class SVM, SVR, etc.) . There is also a post on feature space, and a post on interpretation of SVM feature weights that might help. @ogrisel's answer to the 2nd post above gives you a better analysis on one-vs-all strategy on multi-class SVM.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.