0
$\begingroup$

A couple of points that I need cleared up, thanks ahead for any help.

  • In a D dimensional SVM what is the dimension of the maximal separating plane? Intuitively (and following VC logic) it will be D-1, is that correct....
  • In the derivation of the SVM, what roles do the Lagrangian multiplier play? What do their values indicate?
Improve this question
$\endgroup$
1
  • $\begingroup$ It is a matter of some topological interest that no subspace (or even differentiable submanifold) of dimension less than $D-1$ can separate $D$ dimensional space into two or more connected components. Of greater import is your second question. You might enjoy reading some of our higher-voted threads on SVMs, such as stats.stackexchange.com/questions/3947. $\endgroup$
    – whuber ♦
    Apr 28, 2014 at 22:47

1 Answer 1

Reset to default
1
$\begingroup$

The SVM separating hyperplane is defined as the set of all points $x$ satisfying $w^t x - b = 0$ where $w$ is some nonzero vector (it is the normal to the separating hyperplane).

It is easy to see that $\{x : w^t x - b = 0\}$ is an affine space of dimension $D-1$ since it is equal to $b + w^{\perp}$ and $\dim w^\perp = D-1$ where $w^{\perp}$ denotes the space perpendicular to the span of the vector $w$.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.