AUC is an acronym for Area Under Curve.
2
votes
1answer
45 views
Compare classifiers based on AUROC or accuracy?
I have a binary classification problem and I experiment different classifiers on it:
I want to compare the classifiers. which one is a better measure AUC or accuracy? And why?
...
6
votes
1answer
436 views
What is the difference in what AIC and c-statistic (AUC) actually measure for model fit?
Akaike Information Criterion (AIC) and the c-statistic (area under ROC curve) are two measures of model fit for logistic regression. I am having trouble explaining what is going on when the results of ...
1
vote
2answers
59 views
Is it possible to get high AUC while the correlation between predictor and response is very low, around 0.01?
My data has three continuous predictors and one binary response. I built a logistic regression model but AUC is only 0.52..it's almost like the model did nothing.. Then I calculated the correlation ...
1
vote
0answers
44 views
Intuition behind medium true positive rate, low false positive rate and “acceptable” AUC
I'm looking into some classification tasks at the moment. The test data is unbalanced where one particular class is half the data and the remaining 5 take up the remainder of the test data. When I ...
0
votes
0answers
76 views
What's the difference between AUC and R square
I understand the meaning of AUC and R-square. Either one is a good statisic for evaluating models. But which is better? If I comparing two models A and B, A has higher R square but B has higher AUC, ...
0
votes
0answers
83 views
Comparing Algorithms using AUC, Effect Size, or Box-plot?
I want to compare the performance of two algorithms (one semi-supervised and the other one is an unsupervised algorithm like SVM or Naive Bayes) based on Hedges' effect size calculation).
For this ...
1
vote
2answers
83 views
How to generate ROC Plot for semi-supervised algorithm?
By having a data-set 1000 (900 unlabeled, 100 labeled) record data-set for binary classification, I want to apply a semi supervised algorithm.
The problem is that I don't know how to get values for ...
2
votes
2answers
221 views
Fastest way to compare ROC curves
I have a set of true positive (TP) values which are used to train a model.
I am using 5-fold cross validation to train my model (i.e. split my true positives into 5, use 4/5ths for training and ...
2
votes
1answer
206 views
Decision threshold for a 3-class Naive Bayes ROC curve
I have some doubts regarding how a ROC curve for a 3-class classifier (Naive Bayes) can be built.
Basically, given some test data, the classifier outputs the probabilities for each of the 3 possible ...
0
votes
0answers
30 views
Data mining, Recall and ROC curve [duplicate]
Possible Duplicate:
Recall and AUC of a binary classifier
Can anyone explain this please?
A binary (i.e., two-class) classifier may very well have a recall of 0.0 for one of the classes and ...
2
votes
1answer
180 views
Recall and AUC of a binary classifier
Is it possible for a binary classifier to have a recall of 0.0 for one of the classes and
at the same time an area under the ROC curve (AUC) of ...
3
votes
2answers
1k views
ROC curve for discrete classifiers like SVM: Why do we still call it a “curve”?, Isn't it just a “point”?
In the discussion : how to generate a roc curve for binary classification, I think that the confusion was that a "binary classifier" (which is any classifier that separates 2 classes) was for Yang ...
4
votes
1answer
181 views
Wilcoxon test in boot() function
I'm trying out the boot() function for internal validation of a logistic glm model using the AUC (aka c-statistic) as my performance measure. My problem is that depending on the dataset I use, ...
2
votes
1answer
136 views
AUC vs error rate for classification
I'm trying to build a recommendation system, and have a bunch of (item,item_features,liked) triplets, where liked is binary. Most items are not liked. So I'm running a logistic regression with ...
2
votes
1answer
658 views
Lorenz curve and Gini coefficient for measuring classifier performance
I often use a ROC curve and the area under that curve as a measure of classifier accuracy in 2-class problems, e.g:
...
5
votes
0answers
300 views
AUC in ordinal logistic regression
I'm using 2 kind of logistic regression - one is the simple type, for binary classification, and the other is ordinal logistic regression. For calculating the accuracy of the first, I used ...
2
votes
1answer
343 views
Confidence interval and statistical significance in comparison of AUC
Recently, I have compared two correlated AUC with the method of Delong. Someone said that since the CI’s overlap, we cannot state the two models were different.
I know that the method of Delong ...
2
votes
2answers
1k views
Area under the “pdf” in kernel density estimation in R
I am trying to use the 'density' function in R to do kernel density estimates. I am having some difficulty interpreting the results and comparing various datasets as it seems the area under the curve ...
4
votes
1answer
130 views
Empirical AUC in validation set when no TRUE zeroes
In a cross-validation setting (LASSO penalized logistic regression), I'm calculating AUC. However, I'm interested in the variability of these estimates over the folds (this will give me an indication ...
