Linked Questions

1
vote
0answers
70 views

How Gini importance works [duplicate]

I have searched for how feature importance in random forest works, but I could not understand. Can anyone explain how it works?. How random forest selects feature importance by Gini?
0
votes
0answers
15 views

How to explain an important feature of Decision Tree? [duplicate]

I need to do storytelling about which factor drives an athlete to choose full Ironman race. Right now, let's assume Decision Tree performs well so my strategy is to consider the most important feature ...
31
votes
3answers
22k views

Feature importance with dummy variables

I am trying to understand how I can get the feature importance of a categorical variable that has been broken down into dummy variables. I am using scikit-learn which doesn't handle categorical ...
6
votes
3answers
5k views

In the R randomForest package for random forest feature selection, how is the dataset split for training and testing?

I'm using the randomForest R package to perform a random forest feature selection. I undestand that, after the execution of the randomForest function, I have to check the importance field, and study ...
9
votes
1answer
10k views

Summing feature importance in Scikit-learn for a set of features

I have built a random forest using a set of features (~100), and I want to compare the feature importance for two subsets of features. In scikit-learn, the feature importance sums to 1 for all ...
3
votes
1answer
12k views

Random Forest graph interpretation in R

I have used the following code to plot the random forest model, but I'm unable to understand what they are telling. ...
2
votes
1answer
5k views

Random Forest - Variable Importance Plot Interpretation

After modeling my Random Forest on my full dataset and the necessary predictor variables I am producing the below variable importance plot. I'm currently trying to wrap my head around how to ...
0
votes
1answer
997 views

which feature is the strongest predictor of classification algorithm? [closed]

For any classification/recommendation algorithm how should I approach to decide from a given list of features which is the strongest predictor? Is this known as feature engineering? what analysis ...
1
vote
1answer
81 views

Retaining Random Forest performance while reducing the feature set

Suppose I have trained a random forest on a very high dimensional set of features. Then I have identified the top m features that have the highest Gini index. If I'd now drop all other feature ...
2
votes
0answers
117 views

Random Forest Importance Grouping - Permuation [R]

I was impressed with While's answer here: Relative importance of a set of predictors in a random forests classification in R I was wondering if anyone has found a package or algorithm to group ...