# Improving SVM classification

I have a classification problem (bioinformatics domain) where I have around 333 features. Currently, I am first selecting features (using importance feature of random forest) and then pushing the same through RBF kernel for SVM. On the results front, I have section of data which gives bad results on the classifier. There is feature rscindex, which separates the data into well classified data and incorrectly classified data,i.e data points with rscindex < 0.8 are performingly badly during classification stage. Please give me ideas on how to improve my results on this badly performing section of data. Will using Fisher kernel help (if so is there a library I can use) or is there a sampling technique that I should be looking into.? Please help. Thanks

• How large is your training dataset in number of samples? The ratio of #samples/#features can help on deciding if a non-linear kernel is needed, and if feature selection makes any sense at all. – iliasfl Jun 19 '14 at 11:48
• @iliasfl My positive set is around 2000 and negative set is around 3000. I have reduced the number of features to less than 100 using feature selection. – priyanka Jun 19 '14 at 15:28
• Not sure if it matters with the number of data examples that you have, but you may need to use a weight parameter in your SVM to correct for imbalanced classes. How bad is the performance actually and what do you mean with "a section" of your data? – Ruthger Righart Jun 6 '15 at 11:10

1. make sure your parameters are properly tuned (in the case of SVM you will probably have $C$ and $\gamma$ for the kernel)