Different seeds give different predictions, but if you grow a sufficiently large number of trees will the predictions for different seeds converge?

  • 2
    $\begingroup$ Converge $\ne$ deterministic. $\endgroup$ – Tim Jan 20 at 22:39
  • $\begingroup$ This question is basically answered here. stats.stackexchange.com/questions/348245/… Increasing the number of trees is effectively just increasing the number of random trials, so we can apply the usual convergence results, so we know that predictions will tend toward a mean value. $\endgroup$ – Sycorax says Reinstate Monica Jan 21 at 3:00

I would guess not, because the hyperparameter ‘mtry’ still injects randomness into the features that are included during a particular run, not to mention the randomness in the cases selected during cross validation. If anything I would suspect it becomes ‘more deterministic’ as mtry approaches # of features.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.