I am building a random forest model in R. Based on my research I (hope to) have come up with quite some understanding about how they work, and more importantly when they work.
I simply would like to see my understanding of RF-models cross-validated here.
So here we go (true or false?):
- scaling is not necessary in Random Forest models.
- when dealing with imbalanced data, one could downsample/upsample/use weights. In package
randomForesthowever, the option classwt seems to be unreliable? Therefore I simply downsample my data (50/50) using package Unbalanced. In my final model I will downsample and build the forest K times and take the average of the predictions. Is this wise?
- Random Forests have little problems with highly correlated variables. I have many ideas for new features and would like to include all of them at once and based on importance (MeanDecreaseGini) optionally decide to leave some out. But the correlation between predictors will not influence performance? in other words: the model with extra features will perform at least similar to the one with less variables?