I can't tell from your description if what you're trying to predict is a continuous-valued response or a binary (dichotomous) response. If it's a continuous-valued response, you have a regression problem, and you want to use some kind of a residual-based loss function such as MSE. If it's a binary-valued response, then precision and recall are exactly the right measures to use.
Jack Tanner
- 4.9k
- 4
- 33
- 39