Linked Questions

0
votes
0answers
19 views

How to interpret ROC curve? [duplicate]

I am currently doing a classification problem for classifying the functional class and non-functional class of peptidase cleavage site. The data on non-functional class (negative class) is highly ...
211
votes
5answers
320k views

What does AUC stand for and what is it?

Searched high and low and have not been able to find out what AUC, as in related to prediction, stands for or means.
71
votes
5answers
106k views

How to calculate Area Under the Curve (AUC), or the c-statistic, by hand

I am interested in calculating area under the curve (AUC), or the c-statistic, by hand for a binary logistic regression model. For example, in the validation dataset, I have the true value for the ...
2
votes
0answers
59 views

How to calculate the prediction score of a classificator?

I want to compare a given classification algorithm with others via the Area under the (ROC-)curve metric. Unfortunately this algorithm only outputs the values of the respective confusion matrix (TP, ...
0
votes
2answers
1k views

How can I plot an ROC curve? [closed]

Given this simple data: How can I plot an ROC curve in Microsoft Excel? Step by step instructions would be very helpful. I know my TPR is ~87% and my FPR is ~13%. How do I know where to set the ...
1
vote
1answer
450 views

Determining the validity of ROC curves

ROC curves were generated using ROCR package using only actual and predicted labels(from a SVM) as input. Script: ...
0
votes
1answer
123 views

Logistic-regression probability score used for reordering rows for plotting ROC curve: is it the actual, positive, or negative class probability?

I want to draw my own ROC curve, such as explained in the accepted answer to this question: Understanding ROC curve However, it isn't clearly explained what the 'score' used represents. It is used ...
0
votes
1answer
593 views

ROC AUC and PR AUC: Are the AUC values different for each class?

When dealing with a binary classification problem, where the decision function threshold is being varied from 0 to 1 at step 0.1: When calculating the Area Under the Curve (AUC) for a ROC Curve plot (...
12
votes
4answers
51k views

How to interpret a ROC curve?

I applied logistic regression to my data on SAS and here are the ROC curve and classification table. I am comfortable with the figures in the classification table, but not exactly sure what the roc ...
0
votes
2answers
2k views

what it means to have low ROC AUC?

I have trained two classifiers namely a logistic regression and a decision tree on a data set. When evaluating both models on the testing data set, the decision tree has a ROC AUC = 0.62 but the ...
1
vote
1answer
8k views

varying classification threshold to produce ROC curves.

How can I vary classification threshold to produce ROC curves. I am new to R and I wanted to classify in different algorithm. Since the accuracy of ROC plot is high I wanted to change the threshold ...
6
votes
3answers
11k views

How to create ROC curve to assess the performance of regression models?

I knew that, ROC curve are use to assess the performance of classifiers. But is it possible to generate ROC curve for the regression model? If yes, How?
0
votes
0answers
80 views

How can I plot a ROC from this table? [duplicate]

I'm given a table Class | Probability P .95 N .85 P .78 and so on. I'm asked to construct a ROC. As I understand, a ROC has TP for the ...
0
votes
2answers
541 views

ROC accuracy measure error when no positive values

I have an unbalanced dataset that I am working to either up or down sample to balance out. But in the meantime I've run into an interesting error when calculating the AUC in R using ...
1
vote
1answer
1k views

How do you use a ROC curve to optimize a random forest classifier? [duplicate]

I am using a random forest for a binary classification problem using sklearn. The sklearn implementation outputs both a predicted class, and a probability for each class. The sklearn implementation ...

15 30 50 per page