2
$\begingroup$

I'm following tutorial in xgboost docs: https://xgboost.readthedocs.io/en/latest/model.html

I'm stuck on this step: enter image description here

I don't understand how the first term (loss) was transformed, they seem to not be equal (sympy says so too). I'm thinking there may be some magic with constant term involved?

$\endgroup$

1 Answer 1

2
$\begingroup$

Recall that you're minimizing $obj^{(t)}$ with respect to the function $f_t$. The $\sum(y_i - \hat{y_i}^{(t - 1)})^2$ term, which appears to be missing from the second line, went into the constant, because its derivative with respect to $f_t$ is always going to be zero.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.