9
$\begingroup$

What relations and differences are between statistical learning theory and computational learning theory?

Are they about the same topic? Solve the same problems, and use the same methods?

For example, the former says it is the theory of prediction (regression, classification,...).

$\endgroup$
6
$\begingroup$

Computational learning, more concretely the probably approximately correct (PAC) framework, answers questions like: how many training examples are needed for a learner to learn with high probability a good hypothesis? how much computational effort do I need to learn with high probability such hypothesis? It does not deal with the concrete classifier you are working with. It is about what you can and cannot learn with some samples at hand.

In statistical learning theory you rather answer questions of the sort: how many training samples will the classifier misclassify before it has converged to a good hypothesis? i.e. how hard is it to train a classifier, and what warranties do I have on its performance?

Regretfully I do not know a source where these two areas are described/compared in an unified manner. Still, though not much hope that helps

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.