Questions tagged [f1]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
1 view

How to compare F1-score on a subset of data with the whole test set? [closed]

To test some ML algorithm which predicts one of m classes I can calculate a F1-score (e.g. with average=weighted) on the test set S. My goal is to look at certain subsets of the records in S (...
0
votes
0answers
18 views

How to back out individual confusion matrix values from scalar measures like sensitivity and specificity?

Consider a standard 2X2 Binary Classification Matrix: TP | FP FN | TN From which we can derive sensitivity and specificity, and other measures. Now, let's assume we have ONLY output measures: ...
0
votes
0answers
41 views

F1-Score in a multilabel classification paper: is macro, weighted or micro F1-used?

I read this paper on a multilabel classification task. The authors evaluate their models on F1-Score but the do not mention if this is the macro, micro or weighted F1-Score. They only mention: We ...
0
votes
0answers
22 views

In XGBoost with a f1_score, is the iteration with a lower or higher score the better iteration?

In the following XGBoost script the output states iteration 0 with score 0.0047 is the best score. I would expect iteration 10 with score 0.01335 to be the better score? Output ...
0
votes
0answers
17 views

Why does the 'weighted' f1-score result in a score not between precision and recall?

On the F1 score sklearn page there's a section that explains each of the options for the average parameter. Under the weighted option, it says: "it can result in an F-score that is not between ...
0
votes
0answers
38 views

What is the difference of “normal” F1 and macro average F1 score with binary classification

Please note that I always talk about binary classification here. I do not speak about multi class classification. In case of unbalanced binary datasets it is a good practice to use F1 score. While ...
1
vote
2answers
47 views

Reporting F1 Scores

I have a question with regard to the proper way to report F1 scores. Say I am comparing two algorithms one with F1 score of 0.71 and the other of 0.82. Is it correct to say: "Algorithm 1 obtained an ...