3
$\begingroup$

I trained an SVM to classify images based on some extracted features (using the ISIC dataset). The resulting ROC curve produced by sklearn looks like this: ROC curve

I have don't quite understand the line for class 0 and 1 (orange and green). I have never seen a ROC curve under the diagonal. What does this tell me now and is this even a valid curve? The other computed evaluation metrices are the following if that helps my question. Evaluation

$\endgroup$
0

1 Answer 1

3
$\begingroup$

The curve is valid.

  • The most commonly seen ROC curves have a curve above the diagonal, which indicates that large predicted scores are associated with the label, and low predicted scores are not associated with the label.
  • The diagonal, i.e. the line $\text{TPR}=\text{FPR}$ of a ROC curve corresponds to the model that has a completely random relationship predicted scores and labels.
  • A curve below the diagonal is a model that as predictions which are opposite the labels. Low predicted scores are associated with the label, and high predicted scores are not. This is the opposite of the first case.

For more information about how ROC curves are constructed, see

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.