In statistics, people often talk about unbiased estimators. In machine learning, bias variance trade-off is mentioned all the time.

Does bias in both contexts mean the same thing?

Does an unbiased estimator have a bias for the data it tries to model?

  • 4
    $\begingroup$ yes both biases are the same, they mean $\mathbb{E}_\theta[\hat{\theta}]\ne\theta$. $\endgroup$ – Xi'an Jan 16 '17 at 11:31

Yes, they mean the same thing.

This free chapter covers bias and variance of estimators: http://www.deeplearningbook.org/contents/ml.html

Please see section 5.4, which has a good explanation of what they are.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.