Questions tagged [f1]
The f1 tag has no usage guidance.
7
questions
0
votes
0answers
1 view
How to compare F1-score on a subset of data with the whole test set? [closed]
To test some ML algorithm which predicts one of m classes I can calculate a F1-score (e.g. with average=weighted) on the test set S.
My goal is to look at certain subsets of the records in S (...
0
votes
0answers
18 views
How to back out individual confusion matrix values from scalar measures like sensitivity and specificity?
Consider a standard 2X2 Binary Classification Matrix:
TP | FP
FN | TN
From which we can derive sensitivity and specificity, and other measures.
Now, let's assume we have ONLY output measures: ...
0
votes
0answers
41 views
F1-Score in a multilabel classification paper: is macro, weighted or micro F1-used?
I read this paper on a multilabel classification task. The authors evaluate their models on F1-Score but the do not mention if this is the macro, micro or weighted F1-Score.
They only mention:
We ...
0
votes
0answers
22 views
In XGBoost with a f1_score, is the iteration with a lower or higher score the better iteration?
In the following XGBoost script the output states iteration 0 with score 0.0047 is the best score. I would expect iteration 10 with score 0.01335 to be the better score?
Output
...
0
votes
0answers
17 views
Why does the 'weighted' f1-score result in a score not between precision and recall?
On the F1 score sklearn page there's a section that explains each of the options for the average parameter. Under the weighted option, it says: "it can result in an F-score that is not between ...
0
votes
0answers
38 views
What is the difference of “normal” F1 and macro average F1 score with binary classification
Please note that I always talk about binary classification here. I do not speak about multi class classification.
In case of unbalanced binary datasets it is a good practice to use F1 score. While ...
1
vote
2answers
47 views
Reporting F1 Scores
I have a question with regard to the proper way to report F1 scores. Say I am comparing two algorithms one with F1 score of 0.71 and the other of 0.82.
Is it correct to say:
"Algorithm 1 obtained an ...
