Linked Questions
11 questions linked to/from Why do minor variations in data scaling produce different SVM class boundaries?
20
votes
2
answers
51k
views
Why scaling is important for the linear SVM classification?
When performing the linear SVM classification, it is often helpful to normalize the training data, for example by subtracting the mean and dividing by the standard deviation, and afterwards scale ...
- 201
12
votes
2
answers
18k
views
When using SVMs, why do I need to scale the features?
According to the documentation of the StandardScaler object in scikit-learn:
For instance many elements used in the objective function of
a learning algorithm (such as the RBF kernel of Support ...
- 123
6
votes
3
answers
3k
views
Raw data outperforms Z-score transformed data in SVM classification
I've been trying to perform a binary classification using an SVM classifier (scikit-learn's SVC with RBF kernel). I have a sample size of about 100, with about 70 features each.
The features are of ...
- 218
7
votes
1
answer
6k
views
Feature scaling in svm: Does it depend on the Kernel?
It is often recommended to do feature scaling (e.g. by normalization) when using a Support Vector Machine. For example here:
When using SVMs, why do I need to scale the features?
or also on ...
- 5,151
9
votes
1
answer
2k
views
Why would scaling features decrease SVM performance?
I have used scaling on features of a model which contains 40 features (all columns are numbers) and a binary output variable.
This is the Kaggle contest here I've scaled the features assuming it ...
- 1,111
4
votes
1
answer
2k
views
scaling for SVM destroys my results [duplicate]
I'm applying standard 0-1 scaling of features before SVM classification for financial data but the results are worse. This is the results before scaling
...
5
votes
2
answers
994
views
Why does the scaling of feature vectors improve performance of SVM classifier?
I've found that performing scaling in SVM problems really improves the performance of SVM ... But I don't understand why!
I have read this explanation: "The main advantage of scaling is to avoid ...
- 245
1
vote
1
answer
3k
views
Why is SVM sensitive to scaling of features? [duplicate]
In the formulation of SVM I don't see any step which states that scaling of features should be done for better generalization performance, nor does it come up in its VC dimension expression. So why is ...
- 719
3
votes
1
answer
539
views
What's the score employed by Platt scaling to compute SVM posterior probabilities?
I have read about the Platt scaling approach to compute posterior probabilities for the SVM classifier $P(y=1|x)$. In Scikit-learn's SVC (SVM) implementation this is the approach used to produce ...
- 925
2
votes
2
answers
287
views
Scaling hinge loss in SVM
Recall the functional of primal SVM problem: $\|w\|^2 + C \sum_i \xi_i \to \min$.
Suppose I have 1000 training objects, and want to find optimal $C$ by 2-fold cross-validation. As a result of cross-...
- 63
0
votes
2
answers
271
views
Why is the optimal C chosen by GridSearchCV so small?
I'm trying to use GridSearchCV to select the optimal C value in this simple SVM problem. The issue I'm having is that when I run the code the optimal C is chosen to be ridiculously small (~e-18) so ...
- 3