7
$\begingroup$

This question already has an answer here:

Let $x_i$ be independent Bernoulli random variables with success probabilities $p_i$. That is, $x_i=1$ with probability $p_i$ and $x_i=0$ with probability $1-p_i$.

Is there a closed expression or an approximate formula for the distribution of the sum $\sum_i x_i$?

$\endgroup$

marked as duplicate by whuber Apr 15 '14 at 16:57

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

  • 4
    $\begingroup$ If the $p_i$ are very small, you can use Poisson approximation. Let $X_i\sim \mbox{Be}(p_i)$ be independent and let $Y\sim\mbox{Po}(\lambda)$ with $\lambda=\sum_{i=1}^np_i$. In a classic paper by Hodges and Le Cam it is shown that $|\mbox{P}(\sum_{i=1}^n X_i\leq x)-\mbox{P}(Y\leq x)|=3\cdot (\max_{1\leq i\leq n}p_i)^{1/3}.$ If the $p_i$ are all close to 0, this difference is small. $\endgroup$ – MånsT Apr 15 '14 at 13:15
  • 1
    $\begingroup$ In addition to the duplicate, solutions appear at stats.stackexchange.com/questions/41247 (computational methods) and stats.stackexchange.com/questions/5347 (approximations for large numbers of variables). $\endgroup$ – whuber Apr 15 '14 at 16:59
  • $\begingroup$ @MånsT Hodges and Le Cam's result you state is incorrect. The equality is less than or equal to!!. $\endgroup$ – Chamberlain Foncha Oct 19 '17 at 20:38
  • $\begingroup$ @Chamberlain: you are absolutely right! I can't edit it now though, as my comment is too old. $\endgroup$ – MånsT Oct 20 '17 at 6:23
8
$\begingroup$

Yes, in fact, the distribution is known as the Poisson binomial distribution, which is a generalization of the binomial distribution. The distribution's mean and variance are intuitive and are given by

$$ \begin{align} E\left[\sum_i x_i\right] &= \sum_i E[x_i] = \sum_i p_i\\ V\left[\sum_i x_i\right] &= \sum_i V[x_i] = \sum_i p_i(1-p_i). \end{align} $$

The expectation is straightforward because it is a linear operator. The variance is also straightforward because of the independence assumption.

$\endgroup$
0
$\begingroup$

I'm not aware of a closed formula to exist. If n becomes relevant you can apply Central Theorem Limit so approximating the sum distribution with a normal distribution having mean the sum of p_i and variance the sum of p_i * ( 1 - p_i).

$\endgroup$
  • 1
    $\begingroup$ The CLT often fails (that is, does not even apply) in this circumstance unless the $p_i$ remain away from $0$ and $1$. $\endgroup$ – whuber Apr 15 '14 at 17:01

Not the answer you're looking for? Browse other questions tagged or ask your own question.