0
$\begingroup$

This question already has an answer here:

Short Introduction

In a classification problem, the objective is to identify to which of a set of categories a new observation belongs, on the basis of a set of examples whose category membership is known.

The bottom-line of any solution to this problem is to find a set of features that describes the classification of the examples into the corresponding categories (hypothesis).

When the size of the set of categories is large, we need more information to distinguish among the different categories (e.g., we could look for more features). Also, if the examples for a particular category have high variance (intra-class variance), it is more difficult to find the discriminant due to the existence of collisions between members of different classes.

Question

I'd like to know if there exists a quick exploratory method to evaluate how difficult a learning problem is. For example, I'd like to evaluate the number of collisions between different categories. The problem of training a classifier and performing some sort of cross-validation is that the solution is dependent on the choice of the learning model.

$\endgroup$

marked as duplicate by Sycorax, Peter Flom Aug 12 '18 at 10:50

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

  • 1
    $\begingroup$ is this what you're asking?: stats.stackexchange.com/questions/77278/… $\endgroup$ – charles Feb 24 '14 at 23:30
  • 2
    $\begingroup$ Simultaneous cross-post to CS.SE and cstheory.SE. $\endgroup$ – Artem Kaznatcheev Feb 25 '14 at 1:12
  • $\begingroup$ Please don't cross-post. Cross-posting to multiple StackExchange sites is forbidden by site rules. $\endgroup$ – D.W. Feb 26 '14 at 6:33
  • $\begingroup$ I am sorry, I did it because I didn't know where was the right place to ask. I removed the other two posts $\endgroup$ – synack Feb 26 '14 at 9:59