I've encountered an interview question:

Given several binary labels, each label represents a user will click a certain advertisement or not, we have a trained logistic model and its predicted probability of a user clicking the advertisement. How to evaluate this trained logistic model?

I answered by using different thresholds on the predicted probability, we can easily plot the ROC curve and then area under the curve should be a measure. The interviewer said that this is Okay, but can you give me other methods? I'm wondering how to answer this question. By the way, I failed at last.

         click or not     predicted
user1        1               0.8
user2        1               0.6
user3        0               0.4
...         ...              ...  
usern        0               0.3 

You may want you consider the log loss function to evaluate the accuracy performance of the model. Check this link out that discusses the log loss function.


| cite | improve this answer | |

Not the answer you're looking for? Browse other questions tagged or ask your own question.