I have a homework question about a machine-learning algorithm that uses ensemble learning with simple majority voting. Assuming we have K hypotheses, each with an error ɛ, the question asks us to calculate the formula for the error of the ensemble algorithm. The errors are independent.
I have always been terrible with probability, but I decided to figure this out and I went back and looked at some basics. I used the simple binomial distribution to figure out the probability that exactly m (where m is floor(k / 2) + 1) hypotheses of of K making an error is (K choose m)(ɛ)^m(1 - ɛ)^(K - m). I thought that this would be the answer.
But the correct answer seems to involve adding all the probability of errors. That it, it is the probability of the error of exactly m hypotheses being wrong, plus the probability of m + 1 hypotheses being wrong, and so on until K hypotheses. I don't understand why the all these probabilities need to be added up. Don't we just need the probability that exactly m hypotheses are wrong? Why do we need to add up all the other probabilities of errors?
EDIT Ok I got it. It's because it's majority voting, at least m have to be wrong, but at most K have to be wrong. So we have to add them up.