Linked Questions

1
vote
1answer
1k views

How do you use a ROC curve to optimize a random forest classifier? [duplicate]

I am using a random forest for a binary classification problem using sklearn. The sklearn implementation outputs both a predicted class, and a probability for each class. The sklearn implementation ...
0
votes
0answers
77 views

How can I plot a ROC from this table? [duplicate]

I'm given a table Class | Probability P .95 N .85 P .78 and so on. I'm asked to construct a ROC. As I understand, a ROC has TP for the ...
196
votes
5answers
297k views

What does AUC stand for and what is it?

Searched high and low and have not been able to find out what AUC, as in related to prediction, stands for or means.
65
votes
5answers
99k views

How to calculate Area Under the Curve (AUC), or the c-statistic, by hand

I am interested in calculating area under the curve (AUC), or the c-statistic, by hand for a binary logistic regression model. For example, in the validation dataset, I have the true value for the ...
12
votes
4answers
48k views

How to interpret a ROC curve?

I applied logistic regression to my data on SAS and here are the ROC curve and classification table. I am comfortable with the figures in the classification table, but not exactly sure what the roc ...
10
votes
2answers
24k views

How we can draw an ROC curve for decision trees?

Normally we cannot draw an ROC curve for the discrete classifiers like decision trees. Am I right? Is there any way to draw an ROC curve for Dtrees?
6
votes
3answers
10k views

How to create ROC curve to assess the performance of regression models?

I knew that, ROC curve are use to assess the performance of classifiers. But is it possible to generate ROC curve for the regression model? If yes, How?
8
votes
2answers
10k views

Calculate ROC curve for data

So, I have 16 trials in which I am trying to authenticate a person from a biometric trait using Hamming Distance. My threshold is set to 3.5. My data is below and only trial 1 is a True Positive: <...
1
vote
1answer
7k views

varying classification threshold to produce ROC curves.

How can I vary classification threshold to produce ROC curves. I am new to R and I wanted to classify in different algorithm. Since the accuracy of ROC plot is high I wanted to change the threshold ...
0
votes
4answers
1k views

How is an ROC curve constructed for a set of data?

I know that sensitivity and recall (and precision, and ...
0
votes
2answers
1k views

what it means to have low ROC AUC?

I have trained two classifiers namely a logistic regression and a decision tree on a data set. When evaluating both models on the testing data set, the decision tree has a ROC AUC = 0.62 but the ...
0
votes
2answers
704 views

How can I plot an ROC curve? [closed]

Given this simple data: How can I plot an ROC curve in Microsoft Excel? Step by step instructions would be very helpful. I know my TPR is ~87% and my FPR is ~13%. How do I know where to set the ...
2
votes
1answer
774 views

How to draw the ROC curve?

Currently I'm asking me how to draw the ROC curve (Receiver Operating Characteristic curve). On the x-axis there is the false positive rate (1-specificity) and on the y-axis there is the true positive ...
0
votes
2answers
370 views

ROC accuracy measure error when no positive values

I have an unbalanced dataset that I am working to either up or down sample to balance out. But in the meantime I've run into an interesting error when calculating the AUC in R using ...
0
votes
1answer
408 views

ROC AUC and PR AUC: Are the AUC values different for each class?

When dealing with a binary classification problem, where the decision function threshold is being varied from 0 to 1 at step 0.1: When calculating the Area Under the Curve (AUC) for a ROC Curve plot (...

15 30 50 per page