2
$\begingroup$

If my validation error is smaller than my training error, what does this imply? Does this mean the model is 'underfit'?

$\endgroup$
  • $\begingroup$ Could you elaborate on your question? Perhaps post some code or results? $\endgroup$ – Mark White Jun 9 '17 at 20:45
2
$\begingroup$

A model is considered to be 'underfitting' when both the training and validation error are high. When your validation error is lower than your training error than the fit is obscure and inconclusive.

There are multiple reasons why this can happen but one can't be completely certain. It could be because the test cases during the validation belonged to the type of data that influenced the model the most while training or maybe because the test cases contain the type of data that your model is good at predicting. If there is a very small difference, it could be random.

Although, based on your question it is difficult to comment more specifically without knowing the train-test split method or the evaluation metric.

Regarding underfitting and overfitting you can keep these in mind:

  • Underfitting: High Validation and Training Error
  • Overfitting: High Validation Error and Low Training Error
| cite | improve this answer | |
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.