Linked Questions
21 questions linked to/from How to plot ROC curves in multiclass classification?
6
votes
2
answers
22k
views
How to draw ROC curve with three response variable? [duplicate]
I have a toy example reproduced below in which the response variable has three possible classes. I am trying to create an ROC but not sure how to deal with it when there are three classes. Any help ...
- 969
0
votes
0
answers
2k
views
AUC Scores greater than 1 with multi class classification in R? [duplicate]
I am implementing machine learning algorithm for multiclass classification problem in R programming. The problem is that when I predict the accuracy I am getting around 90% accuracy but when I ...
- 409
1
vote
0
answers
183
views
Visualizing multi-class ROC analysis [duplicate]
I am running a multinomial logistic regression model (with 3 possible outcomes) in R. I am trying to find the best way to assess the predictive power/accuracy of the model, and the best thing I've ...
- 11
1
vote
0
answers
101
views
question on presenting multiclass classification results [duplicate]
I'm trying to figure out how to present results (e.g. precision, recall, accuracy, ROC curve) for a class project.
I have a multi-class classification problem(specific classification algorithm not ...
- 2,093
56
votes
10
answers
82k
views
How to choose between ROC AUC and F1 score?
I recently completed a Kaggle competition in which ROC AUC score was used as per competition requirement. Before this project, I normally used F1-score as the metric to measure model performance. ...
- 803
43
votes
3
answers
45k
views
How to determine the quality of a multiclass classifier
Given
a dataset with instances $x_i$ together with $N$ classes where every instance $x_i$ belongs exactly to one class $y_i$
a multiclass classifier
After the training and testing I basically have a ...
- 2,101
13
votes
1
answer
12k
views
How to form a Precision-Recall curve when I only have one value for P-R?
I have a data mining assignment where I make a content-based image retrieval system.
I have 20 images of 5 animals. So in total 100 images.
My system returns the 10 most relevant images to an input ...
- 1,342
5
votes
1
answer
7k
views
Neural net with hidden layer performing worse than without?
I'm attempting to train a classifier on a single input vector of length 3000, and trying to predict which of 30 classes each input vector belongs to.
With 1M labeled input/output examples (split 80% ...
- 101
2
votes
1
answer
10k
views
How to plot ROC for multi-class classifier? One-vs-All or One-vs-One?
I am trying to evaluate a multi-class classification model, say Random Forest, I built in R. So far, my approach has been looking at the ConfusionMatrix from the <...
- 123
1
vote
2
answers
11k
views
Calculate AUC using sensitivity and specificity values only
How to calculate AUC, if I have values of sensitivity and specificity for various threshold cutoffs?
I have sensitivity and specificity values for 100 thresholds.
...
3
votes
1
answer
6k
views
With multinomial regression, how to predict an event and get the ROC curve?
I'm using the multinom package in R to run a multinomial logistic regression model. My dependent variable has 3 levels and as the output, I'm getting the ...
- 31
1
vote
1
answer
4k
views
Multi-class Confusion Matrix to Binary confusion matrix
I know the main concepts of data/text mining but I used them mainly in binary classification problems (just two classes). I am now dealing with a problem with 8 classes and struggling to calculate an ...
- 13
2
votes
1
answer
3k
views
Comparing confusion matrices from model fitting
Using R, I got a bunch of confusion matrices from some model fitting. I'm trying to choose the best model by looking at their confusion matrix. Not an easy task.
My current method of comparison is to ...
- 153
4
votes
1
answer
2k
views
How to measure the accuracy of multinomial target?
I have trained a model that predicts a multinomial output (a.k.a. multi-class classification). Would anyone know how the accuracy can be measured?
The target takes one of the following values: "...
- 41
3
votes
1
answer
2k
views
How to find classifier success performance?
EDIT
I am playing with pattern recognition techniques and just to get a grip of it for simplicity I have tried to develop a classifier which categorizes strings into 3 classes based on the ...
- 439