It was my understanding that SVMs did not rely upon the initialization of random weights in the way that Neural Networks do, and that therefore, results of running an SVM model would be consistent given identical data.
So why, then, do I get different results for my $best.parameters (gamma and cost) for the following call to e1071 package's tune.svm() every time I run it?
tune_out <- tune.svm(x = X_train, y = as.factor(y_train), type = "C-classification", kernel = "radial",
cost = c(.01, .1, .5, 1, 2.5, 5, 7.5, 10, 20, 50, 100, 500, 1000), gamma = c(0.1,.5, 1,5, 10,20,50,100), scale = FALSE)
My training set is hard-coded and doesn't vary, so I'm at a loss as to what is going on.
FYI- I have set scale to FALSE as my data is already centered and scaled.