How to improve SVM performance on data with missing features and outliers?

I'm trying to learn R for ML purposes, and right now i'm building classifier for my data (10 dimensions, ~400 elements, 2 classes), which have some outliers in it, and a lot of missing values.

I'm using multi-imputation of missing values from Amelia package and e1071 SVM. My results are quite good: 80% quality on cross-validation.

Question: Is there any best practices or advices for building classifier on such a bad data? Maybe I should somehow filter outliers first? Maybe I should consider some other method for imputing missing values?

-

If you feel like you are getting good results, what is the problem? Are you not identifying enough true positives? Are you identifying too many false positives. If it's one or the other, choose a more liberal or conservative threshold for predicting the classes. If it's both, there's probably not all that much you can do without getting more data or creating derived features. If you using a SVM, then it would be natural to try using various kernels, since using a kernel is implicitly creating derived features.

As far as the modifications you suggest: Removing outliers should not help you since one of the properties of SVM is that it effectively ignores all the data that is far from the decision boundary (Assuming that the two classes are linearly separable in your feature space. If not, then you do need to worry about outliers).

-
"since one of the properties of SVM is that it effectively ignores all the data that is far from the decision boundary". This statement is incorrect. SVM is actually very sensitive to outliers. There is still ongoing research on how to supress the influence of outliers like this one for example. –  TenaliRaman May 13 '12 at 16:18
I should have specified that SVM's resistance to outliers only hold if the classes are separable. I'll make the change. –  fgregg May 13 '12 at 17:51
fgregg: you mean linearly separable. –  user603 May 13 '12 at 19:30
I mean linearly separable in some feature space. –  fgregg May 13 '12 at 19:33
Start by removing the outliers from your design matrix (for this step you can only use whichever of those 10 variables that are continuous). You can do this rather easily using the $\verb+CovMcd()+$ function in the $\verb+rrcov()+$ library. $\verb+CovMcd()+$ will basically give you the index of the 50 percent most concentrated observations. Use only those to build your SVM classification model (but this time including all the variables in your model, even the discrete ones). Compare the performances of this model with that of the one you have now. Let us know if it improves the fit on the test set. It'll give good information on what type of outliers you have.