5
$\begingroup$

Are accuracy and precision the same things in regression and classification?

In regression: accuracy is bias, and precision is inverse of variance.

In classification: accuracy is correct prediction over number of samples, and precision is true positives over all predicted positives.

$\endgroup$

2 Answers 2

5
$\begingroup$

As you've pointed out, they are not the same, and sometimes refer to wildly different things (i.e., precision is a property of the model in classification, and refers to a measure of variance in regression). Unfortunately, in statistics and i'm sure other disciplines, we tend to abuse notation and use the same word to denote different things. You've pointed out a great example.

Precision and Accuracy

Precision in the context of regression, more specifically linear regression and the normal distribution refers to the Precision matrix, where X is a multivariate, normally distributed variable

$X \sim MVN(\mu, \Sigma), \hspace{4mm} \text{where } \Sigma^{-1} = \text{Precision Matrix} $.

In the context of classification, Precision is also known as PPV (or positive predictive value), and that refers to how "good" your model is at idnetifying true cases among the predictions.

$PPV = \text{Precision} = \frac{TP}{TP + FP}$

where TP/FP = True and False positives, respectively. Some communities use PPV, and some communities use precision. They mean the same.

Similarly, with Recall and Sensitivity, you measure how good you are at "catching" all the positive cases.

I think the best thing is to follow Bane's lead above, and create a cheat-sheet or notecards with these terms to not confuse them since they can easily get mixed up and be referred to constantly in ambiguous settings.

$\endgroup$
1
$\begingroup$

enter image description here

Accuracy is the overall accuracy of the model. It is the ratio of

(total number of correct predictions) / (total population)


Precision (Positive Prediction Value) on the other hand is the ratio of

(correctly predicted as positive) / (total number of positive predictions)

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.