I am using
gbm to predict an imbalanced binary outcome, with the intent of obtaining a ranking by class probability estimation that produces a strong class separation on out-of-sample data. (I am combining this class probability with other predictions, including from logistic regression, in an ensemble model.)
According to this gbm vignette (Ridgeway, 2007), under "common user options" for loss functions:
This should be easily dictated by the application. For most classification problems either
adaboostwill be appropriate, the former being recommended. (p. 5)
Related question, but broader than mine: Choosing between loss functions for binary classification. This answer references Bartlett (2006) which is a challenging read for me.
Although performance is satisfactory under the bernoulli loss function, I am having a hard time understanding the justification for selecting one over another. I'm trying all of them, but are there any theoretical justifications that are at least somewhat intuitive?