Tell me please, what method of decreasing the number of attributes (features) can be applied to the Bayesian classifier in Python? Thank you
1
-
$\begingroup$ I think PCA might work well with Naive Bayes... $\endgroup$– Djib2011Sep 16, 2018 at 17:00
Add a comment
|
1 Answer
$\begingroup$
$\endgroup$
PCA. If a few principal components explain a significant portion of the variance, you could achieve meaningful dimension reduction this way.
PCA also has the added benefit of giving you uncorrelated variables, which helps with satisfying the Naive Bayes assumptions (i.e. Naive Bayes assumes that given the class, feature are independent).
You could also take a look at factor analysis, and checking if your factor loadings are interpretable (although I guess that's not super important for an ML application). Factor scores are also uncorrelated.
