would adding the probabilities in a dataset be more accurate than the individual results? Say I have the titanic kaggle competition, but I'm not interested in the competition for predicting survival for each individual. Instead I want the most accurate estimate of total survivors on the titanic. Would this be achieved by using a probabilistic model, then adding the probabilities for each individual? For example, if I have 3 people and 1 survived, but my model produced 0.4, 0.4, and 0.4 probabilities for each person to survive, I calculate 0 survived. But if I add 0.4 for each person, I get 1.2, which is closer to the actual. Does this make sense?
 A: A classificator is only trained to be good with the tendency,  not the number.  It does not return a probability, but a certainty (not necessarily on an obvious scale). 
There may be cases where the surviving cance is e. g.  75% and the classifier is 99% certain of this (and thus return 0.99 for surviving being the best guess). 
If you want to use the number, learn regression or carefully calibrate your classifier. 
A: The approach makes sense to me.  I would be careful though with the interpretation of the "probability" that some machine learning algorithms produce. The logistic regression directly models the probabilities. If correctly specified, then the output can be interpreted as "probability". Neural nets are similar; they can be seen as logistic regression with highly complex feature extraction.
I am not sure about the tree-based methods. As far as I know, there is no consensus if we can interpret the "scores" of methods like the random forest as "probabilities".  As you said, the scores indicate the fraction of trees that judged the positive. The trees are samples from possible models, whereas what we want is samples from trials. I find no clear link between them.
As a result, I personally see the scores from the random forest just as scores. The higher the score, the larger the probability. Perhaps they are a monotonic transformation of probabilities, but not necessarily equal.
That said, I would be happy if someone could correct me if my interpretation is wrong.
