In this article http://xgboost.readthedocs.io/en/latest/model.html under the caption Tree Ensemble, the diagram shows 3 prediction score under the 3 nodes, +2, +0.1, and -1. How were these numbers derived? The article gave no clue.

  • $\begingroup$ I believe they are just for illustration. You compute the predictions from the regression trees in a gradient booster in the same way as any other regression tree: as the mean of y over all the training samples share the same leaf node as the given sample point. $\endgroup$ Jul 23 '17 at 22:25
  • $\begingroup$ stats.stackexchange.com/questions/353406/… .. please answer here if you found it $\endgroup$ Jun 27 '18 at 14:40

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.