I have a data collection with a mixed feature set consisting of both numerical features and text features. The number of numerical features is quite small, i.e., 6, comparing to the number of text features, i.e., 2000. ( The data set is a csv file, where there are 6 columns consisting of digit values only; other columns are just plain texts). We found that removing these numerical features (columns) in fact improves the performance. However, when we conduct the feature selection based on the information gain, looks like those numerical features gets more weight. How to explain this scenario?

  • $\begingroup$ What technique(s) are you using for feature selection and classification? $\endgroup$ – sharky Nov 19 '13 at 22:24
  • $\begingroup$ I used SVM to do the classification. I use information gain to do the feature selection. $\endgroup$ – user785099 Nov 20 '13 at 3:26
  • 1
    $\begingroup$ Are you scaling the feature vector data for the SVM? $\endgroup$ – sharky Nov 20 '13 at 5:58

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.