Skip to main content
3 of 4
edited tags
Dave
  • 67.1k
  • 7
  • 105
  • 305

Overfitting, but why is the training deviance dropping?

The test set values increase over iterations signaling overfitting, but why is the training set deviance continuing to drop at the same time? This seems to indicate to me that the training set is continuing to get better over iterations but the test set only worsens, there is also a large gap in the starting points of the deviance between the test and training sets. Any clues as to where to look for causes would be helpful.

results of GBM regressor

Roger
  • 47
  • 3