Tell me more ×
Cross Validated is a question and answer site for statisticians, data analysts, data miners and data visualization experts. It's 100% free, no registration required.
up vote 0 down vote favorite

Both my independent and dependent variables are binary. My result for classification table is 72% for predicted, and my ROC curve area is 0.389. Since <0.5 for ROC area is the worst for accuracy model, what should I do?

share|improve this question
2  
What is 72%? what are you measuring? If AUC is below 0.5, maybe there is some error in how you compute it. Have you by any chance inverted your predictions by mistake? – ALiX Jun 22 '12 at 18:13
To have an ROC below 0.5 there must be some threshold where both classification error rates are below 0.5. However it is possible that for some threshold at least one prediction rate is above 0.5. So what you claim is possible. – Michael Chernick Jun 22 '12 at 19:00
No one can answer this without knowing what your problem is and what method(s) are you using. – mbq♦ Jun 22 '12 at 19:54
Yup; the nice way to have ROC<0.5 is to accidentally swap class labels (as ALiX said), the painful way is to have a paradox problem (i.e. when test contains many objects with the same predictor values as in train but labelled differently). – mbq♦ Jun 22 '12 at 20:04
I didn't mean for it to be an answer. I should have made it a comment to relate to ALiX's question. I will change that. – Michael Chernick Jun 22 '12 at 20:10
show 3 more comments

Know someone who can answer? Share a link to this question via email, Google+, Twitter, or Facebook.

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.