Skip to main content
Tweeted twitter.com/#!/StackStats/status/447100002792644609
small trouble with singulars and plurals: did my edits help?
Source Link
Nick Cox
  • 59.5k
  • 8
  • 136
  • 212

SVM primal formulation,: does the constants constraintsconstraint matter?

When finding the maximum margin separator in the primal form we have the quadratic program:

$$min\frac{1}{2}||\theta||^2$$ $$\text{ subject to: } y^{(t)}(\theta \cdot x^{(t)} + \theta_0) \geq 1, \ t=1,...,n$$$$\text{ subject to: } y^{(t)}(\theta \cdot x^{(t)} + \theta_0) \geq 1, \ t=1,...,n,$$

Sayingsaying basically to find the maximum margin separator. The margin size will be:

$$\frac{1}{||\theta||}$$$$\frac{1}{||\theta||}.$$

doesDoes the size of the margin change whetherif we change the constantconstants of the constraintsconstraint?

i.e.That is, if we have:

$$\text{ subject to: } y^{(t)}(\theta \cdot x^{(t)} + \theta_0) \geq k, \ t=1,...,n$$$$\text{ subject to: } y^{(t)}(\theta \cdot x^{(t)} + \theta_0) \geq k, \ t=1,...,n,$$

instead of 1?

If it does not matter, why doesn't this matter? How is it an equivalent formulation regardless of the exact constantconstants for the constraint?

SVM primal formulation, does the constants constraints matter?

When finding the maximum margin separator in the primal form we have the quadratic program:

$$min\frac{1}{2}||\theta||^2$$ $$\text{ subject to: } y^{(t)}(\theta \cdot x^{(t)} + \theta_0) \geq 1, \ t=1,...,n$$

Saying basically to find the maximum margin separator. The margin size will be:

$$\frac{1}{||\theta||}$$

does the size of the margin change whether we change the constant of the constraints?

i.e. if we have:

$$\text{ subject to: } y^{(t)}(\theta \cdot x^{(t)} + \theta_0) \geq k, \ t=1,...,n$$

instead of 1?

If it does not matter, why doesn't this matter? How is it an equivalent formulation regardless of the exact constant for the constraint?

SVM primal formulation: does the constants constraint matter?

When finding the maximum margin separator in the primal form we have the quadratic program

$$min\frac{1}{2}||\theta||^2$$ $$\text{ subject to: } y^{(t)}(\theta \cdot x^{(t)} + \theta_0) \geq 1, \ t=1,...,n,$$

saying basically to find the maximum margin separator. The margin size will be:

$$\frac{1}{||\theta||}.$$

Does the size of the margin change if we change the constants of the constraint?

That is, if we have

$$\text{ subject to: } y^{(t)}(\theta \cdot x^{(t)} + \theta_0) \geq k, \ t=1,...,n,$$

instead of 1?

If it does not matter, why doesn't this matter? How is it an equivalent formulation regardless of the exact constants for the constraint?

edited title
Link
user88
user88

SVM primal formulation, does the constants constraints matter/?

Source Link
Charlie Parker
  • 7.1k
  • 14
  • 77
  • 130

SVM primal formulation, does the constants constraints matter/

When finding the maximum margin separator in the primal form we have the quadratic program:

$$min\frac{1}{2}||\theta||^2$$ $$\text{ subject to: } y^{(t)}(\theta \cdot x^{(t)} + \theta_0) \geq 1, \ t=1,...,n$$

Saying basically to find the maximum margin separator. The margin size will be:

$$\frac{1}{||\theta||}$$

does the size of the margin change whether we change the constant of the constraints?

i.e. if we have:

$$\text{ subject to: } y^{(t)}(\theta \cdot x^{(t)} + \theta_0) \geq k, \ t=1,...,n$$

instead of 1?

If it does not matter, why doesn't this matter? How is it an equivalent formulation regardless of the exact constant for the constraint?