This question already has an answer here:
- How is a ROCAUC=1.0 possible with imperfect accuracy? [duplicate] 1 answer
- When is accuracy score preferred to AUCROC? 1 answer
- Why is AUC higher for a classifier that is less accurate than for one that is more accurate? 3 answers
- Why is accuracy not the best measure for assessing classification models? 7 answers
- Why AUC =1 even classifier has misclassified half of the samples? 3 answers
I'm testing several classifiers in Weka Experimenter. Some of them have — at the same time — low accuracy (Percent_correct statistic) and high AUC. How should the quality of such classifiers be interpreted? Should they be considedered bad (for their low accuracy) or good (for their high AUC)? Under which circumstances one or the other of these performance measures should prevail in judging quality?
Note: Both questions mentioned in the comments below add useful insights. However, I would also like to know when you want to strieve for accuracy (possibly at the cost of worse AUC) and when you want to strieve for better AUC (possibly at the cost of worse accuracy).