Skip to main content
willk's user avatar
willk's user avatar
willk's user avatar
willk
  • Member for 7 years, 8 months
  • Last seen more than 1 year ago
awarded
awarded
awarded
awarded
awarded
awarded
awarded
awarded
awarded
awarded
awarded
comment
What makes a Random Forest random besides bootstrapping and random sampling of features?
I modified the question (increasing the depth of the trees results in more predictions that disagree) and added some visualizations. I'll also ask on GitHub when I can.
revised
What makes a Random Forest random besides bootstrapping and random sampling of features?
Added images of regression trees to elucidate the problem.
Loading…
revised
Loading…
comment
What makes a Random Forest random besides bootstrapping and random sampling of features?
Thanks for the answer. It might be worth digging into the sklearn code to find out what is non-deterministic. I'm still working on looking at the trees, but it seems like if bootstrap=False and all the features are used, then each tree in the forest is exactly the same!
comment
What happens when bootstrapping isn't used in sklearn.RandomForestClassifier?
I asked the question here. Still working on visualizing the individual trees, but it appears setting bootstrap=False and using all the features does not produce identical random forests, at least in Scikit-Learn. Whether this is because of the particular implementation remains to be seen!
Loading…
comment
What happens when bootstrapping isn't used in sklearn.RandomForestClassifier?
This seems like an interesting question to test. Should be pretty doable with Sklearn since you can even print out the individual trees to see if they are the same.
comment
What happens when bootstrapping isn't used in sklearn.RandomForestClassifier?
This is a great explanation! Does this mean if bootstrap=False and each split uses all the features (no random subsampling) then the forest is not random?
awarded