Questions tagged [auc]

AUC stands for the Area Under the Curve and usually refers to the area under the receiver operator characteristic (ROC) curve.

Filter by
Sorted by
Tagged with
8
votes
1answer
2k views

Decision threshold for a 3-class Naive Bayes ROC curve

I have some doubts regarding how a ROC curve for a 3-class classifier (Naive Bayes) can be built. Basically, given some test data, the classifier outputs the probabilities for each of the 3 possible ...
3
votes
2answers
2k views

Recall and AUC of a binary classifier

Is it possible for a binary classifier to have a recall of 0.0 for one of the classes and at the same time an area under the ROC curve (AUC) of ...
27
votes
3answers
27k views

ROC curve for discrete classifiers like SVM: Why do we still call it a “curve”?, Isn't it just a “point”?

In the discussion : how to generate a roc curve for binary classification, I think that the confusion was that a "binary classifier" (which is any classifier that separates 2 classes) was for Yang ...
6
votes
1answer
659 views

Wilcoxon test in boot() function

I'm trying out the boot() function for internal validation of a logistic glm model using the AUC (aka c-statistic) as my performance measure. My problem is that depending on the dataset I use, ...
2
votes
1answer
1k views

AUC vs error rate for classification

I'm trying to build a recommendation system, and have a bunch of (item,item_features,liked) triplets, where liked is binary. Most items are not liked. So I'm running a logistic regression with ...
1
vote
0answers
2k views

Binary classification and ROC curve area less than .5

Both my independent and dependent variables are binary. My result for classification table is 72% for predicted, and my ROC curve area is 0.389. Since <0.5 for ROC area is the worst for accuracy ...
5
votes
1answer
10k views

Lorenz curve and Gini coefficient for measuring classifier performance

I often use a ROC curve and the area under that curve as a measure of classifier accuracy in 2-class problems, e.g: ...
9
votes
2answers
4k views

AUC in ordinal logistic regression

I'm using 2 kind of logistic regression - one is the simple type, for binary classification, and the other is ordinal logistic regression. For calculating the accuracy of the first, I used cross-...
2
votes
1answer
1k views

Confidence interval and statistical significance in comparison of AUC

Recently, I have compared two correlated AUC with the method of Delong. Someone said that since the CI’s overlap, we cannot state the two models were different. I know that the method of Delong ...
15
votes
2answers
13k views

Area under the “pdf” in kernel density estimation in R

I am trying to use the 'density' function in R to do kernel density estimates. I am having some difficulty interpreting the results and comparing various datasets as it seems the area under the curve ...
5
votes
1answer
227 views

Empirical AUC in validation set when no TRUE zeroes

In a cross-validation setting (LASSO penalized logistic regression), I'm calculating AUC. However, I'm interested in the variability of these estimates over the folds (this will give me an indication ...

1
5 6 7 8
9