The Bernoulli distribution is a discrete distribution parametrized by a single "success" probability. It is a special case of the binomial distribution.

learn more… | top users | synonyms

1
vote
0answers
10 views

Estimating conditional probability of bernoulli data

Assume I have $i=1,\dots,N$ fathers, each with $j=1,\dots,n_i>0$ sons. Now there is a binary event $A_{i,j}$ with outcomes 1 and 0 and the respective probabilities $p$ and $1-p$. Now I want to ...
4
votes
1answer
39 views

Accounting for non normality

I have a random variable, supposedly from a Bernoulli distribution, and I want to do some tests on its mean. I'd like to assume that the sample mean is normally distributed, but I'm not sure how ...
1
vote
1answer
35 views

Estimating the true distributions from a sample of distributions

I am having a hard time formulating the following problem. Consider a company that runs a survey across several cities in the US to estimate the percentage of right-handed people and left-handed ...
0
votes
2answers
123 views

Expected number of tosses till first head comes up

Suppose that a fair coin is tossed repeatedly until a head is obtained for the first time. What is the expected number of tosses that will be required? What is the expected number of tails that will ...
0
votes
0answers
13 views

Constructing hypothesis tests and error statistics for a bernoulli distribution

I'm trying to use a bernoulli distribution (which seems simpler than a normal distribution) to get a grip on the basic construction of hypothesis tests. So, we have a coin. Its probability of ...
6
votes
2answers
130 views

Linear combination of discrete variables $T_i$ with $P(T_i=1)=P(T_i=-1)=1/2$

Let $T_1,...,T_n$ be iid with a Rademacher distribution; i.e., $P(T_i=1)=P(T_i=-1)=1/2$; and let $w = (w_1,...,w_n) \in \mathbb{R}^n$ without further constraints on $w$. Is there a way to compute ...
2
votes
0answers
56 views

Sample size needed to estimate probability of “success” in Bernoulli trial

Suppose a game offers an event which upon completion, either gives a reward, or gives nothing. The exact mechanism for determining whether the reward is given is unknown, but I assume a random number ...
8
votes
2answers
154 views

Fisher information matrix determinant for an overparameterized model

Consider a Bernoulli random variable $X\in\{0,1\}$ with parameter $\theta$ (probability of success). The likelihood function and Fisher information (a $1 \times 1$ matrix) are: $$ \begin{align} ...
2
votes
1answer
54 views

When to use a normal approximation of a Bernoulli distribution

What is a practical example where one would want to use a normal approximation of a binomial distribution over using properties of the binomial distribution itself? I.e if I already know that the ...
1
vote
1answer
69 views

Text Classification using TfIdf and Bernoulli NB

So, as I am reading about Bernoulli distribution and text classification, I want to understand how Bernoulli uses TfIdf features? Since TfIdf values are within [0-1) but Multivariate Bernoulli assumes ...
1
vote
1answer
38 views

Independent events in sequence

If I flip a fair coin twice, the probability of at least one Head is 0.75 (HH, HT, TH and TT). I flip the coin once and it lands Tails. In order to get at least one Head, the probability of the ...
1
vote
1answer
44 views

How to prove Bernoulli distribution belongs to the exponential family

According to a book, a distribution belongs to the exponential family if it can be written in the form of I wrote the Bernoulli distribution as $\exp\Big(y \log\,[{\mu}/{(1-\mu)}] + ...
2
votes
1answer
62 views

Sequential testing for a Bernoulli variable

Suppose $T$ is a Bernoulli random variable, such that $T = 1$ with probability $s$, $s$ is not known. I am interested in checking hypothesis $H_1$ that $s \neq 1/2$ ($H_0$ is that $s = 1/2$). One way ...
6
votes
3answers
469 views

Logistic Regression - Error Term and its Distribution

On whether an error term exists in logistic regression (and its assumed distribution), I have read in various places that: no error term exists the error term has a binomial distribution (in ...
0
votes
1answer
23 views

Computing mixture of Binomial distributions

I'm trying to model a simple Bayes net, with $n$ samples based on a (unobservable) Bernoulli parameter, representing a true state of the world. Let $T$ be a Bernoulli random variable, with ...
2
votes
0answers
17 views

Is there a test of pair-wise independence for a sequence of non-identical Bernoulli random variables?

Given a sequence of $n$ instances of Bernoulli random variables $x_1,\ldots,x_n$, I am interested in testing whether $x_i$ is independent of $x_{i-1}$ for $i=2,\ldots,n$ (i.e. ...
1
vote
1answer
38 views

Testing for samples being drawn from identical Bernoulli r.v.'s

Suppose that I have a sequence of size $n$: $x_1,\ldots,x_n$, $x_i\in\{0,1\}$. My null hypothesis is that all $n$ members of the sequence are drawn independently from an identical Bernoulli ...
2
votes
1answer
81 views

Mean and Variance for a sum of independent weighted bernoulli random variables with different probabilities of success

Suppose $Z_i$ are independent Bernoulli random variables with differing probabilities $P_i$. Also suppose weights $W_i$ are positive and constant. Can you tell me the mean and variance for the ...
2
votes
1answer
122 views

maximum-likelihood of a sequence of events described by a Bernoulli distribution

I am having quite some troubles with the following homework: In a city it's measured for the whole year whether it rained or not. A distribution $\textrm{Bernoulli}(r_t|\rho)$ characterizes the ...
1
vote
1answer
17 views

Change detection in a Bernoulli sequence

Suppose $X_1, X_2, \ldots, X_n$ is a sequence of independent Bernoulli random variables with (say) $$X_i \sim \begin{cases} \mathrm{Ber}(0.1) & 1 \leq i \leq an \\ \mathrm{Ber}(0.2) & an+1 ...
2
votes
4answers
1k views

Test if two binomial distributions are statistically different from each other

I have three groups of data, each with a binomial distribution (i.e. each group has elements that are either success or failure). I do not have a predicted probability of success, but instead can ...
1
vote
1answer
61 views

Sum of Beta-Bernoulli variables

Assume you have $x_i \sim \operatorname{Bernoulli}(p_i)$ with $p_i \sim \operatorname{Beta}(\alpha,\beta)$. I am exploring $Z=X_1+ \dots +X_n$ According to this page, it is $Z \sim ...
6
votes
1answer
136 views

Is there a name for this process/ distribution?

Does the equation below have a name, or is it similar to some other well-known process/ equation? Equation of interest: $$S_c = S_{c-1} + S_{c-1}\omega_c\delta_c$$ $\delta\sim\mathcal{N}(0,1)$ is a ...
1
vote
0answers
40 views

Probability function of number of fails to first success

I quote the question: In some cultures, it is important to have at least one son. The plan is to have children until one son is born. Find the PDF of the number of daughters in a family. The ...
2
votes
1answer
70 views

Simple scheme to sample from the Bernoulli distribution

I was implementing a simple scheme of Bernoulli distribution sampler. $ X \sim B(p) $. I have a function that generates a uniform random number $r \in (0,1)$. Then, I set $ X = 1 $ if $p > r $, ...
0
votes
0answers
52 views

Bayesian hypothesis test

Given a i.i.d sample $X_{1},..,X_{n}$ of bernoulli random variables test 2 hypotheses $H_{0}:p=2/3$ and $H_{1}:p=1/3$. Bayesian prior is $\pi(2/3)=1/3$ and $\pi(1/3)=2/3$. Find the bayesian criterion ...
1
vote
1answer
146 views

Hypothesis test for Bernoulli

Let $X_{1},..,X_{36}$ be a sample from a Bernoulli distribution with parameter $p$. The sample proportion is $\frac{1}{3}$. Consider a normal approximation test $H_{0}:p=0.5$ vs $H_{1}:p\neq 0.5$, ...
1
vote
2answers
322 views

How can I determine statistical significance in an A/B test in which the KPI is dependent upon two variables - one bernouli and one continuous?

In my work in online marketing, we frequently run A/B or multivariate web page tests. The Key Performance Indicator for these tests is overall Revenue. The treatment that nets the most revenue, either ...
5
votes
2answers
424 views

Sum of Bernoulli variables with different success probabilities [duplicate]

Let $x_i$ be independent Bernoulli random variables with success probabilities $p_i$. That is, $x_i=1$ with probability $p_i$ and $x_i=0$ with probability $1-p_i$. Is there a closed expression or an ...
3
votes
1answer
47 views

Determine if many coins are fair

Imagine I have many coins ($>100$), and for each coin I have the data: $(n_{\rm heads}, n_{\rm tails})$ where $\sum(n_{\rm heads}, n_{\rm tails})$ is decreasing for each next coin. Any one of the ...
3
votes
2answers
69 views

Comparing Bernoulli means across subpopulations in which the number of observed successes may be zero

I've got a binary characteristic and a population $S$ with size $n$ and $P[X] = p$ such that $p$ may be small and $n$ is extremely large. Within this population are subpopulations of various sizes ...
0
votes
1answer
36 views

tight bound of bernoulli sums with unknown dependency

Consider n random variables $X_1, \ldots, X_n$ all follow same bernoulli distribution of mean $p$. But the dependency of these variables are unknown (i.e., cannot assume that they are independent). ...
2
votes
0answers
48 views

The probability that one bernoulli process has a higher p than another?

I have two data generating processes that are independent Bernoulli processes with probabilities of success $p_A$ and $p_B$. I am taking repeated samples from these two data generating processes, so ...
4
votes
1answer
197 views

Normal Approximation of the sum of correlated Bernoulli Random Variables

Hi I am looking for a result (if it exists !!!) in the direction of Normal approximation for sum of correlated Bernoulli random variables (edit : with the same parameter $p$) where correlation between ...
2
votes
1answer
130 views

CLT can be used for weighted sum of different Bernoulli variables?

Suppose $$ z_i \sim Bernoulli (p_i) $$ Can we use CLT for the following weighted sum? $$ S = \sum_i w_i z_i $$ i.e. can $S$ be approximated with a normal distribution? If yes, with which theorem? ...
0
votes
1answer
165 views

Binom.test error in R: “ formal argument ”p“ matched by multiple actual arguments”

I'm running a binom.test on the data set UCBAdmissions (comes with R) and am stuck on an error message. About the data: ...
0
votes
1answer
96 views

Multiple Bernoulli and Multinomial Distirbution

It's well known that language can be modeled by Multinomial distribution and Multiple Bernoulli distribution. So far I don't see any advantage of Multiple Bernoulli distribution representation over ...
2
votes
1answer
257 views

How to get distribution of sum of dependent bernoulli variables

I have $N$ Bernoulli variables, $X_1,...,X_N$ and $X_i\sim B(1, \pi_i)$, $\pi$ is known for each $X_i$, and $Y=X_1+...+X_N$, now I need to get the destribution of $Y$. If $X_i$ and $X_j$ are ...
1
vote
1answer
55 views

Relationship between Bernoulli and Normal CDF

Is there any relationship between the draw from a Bernoulli with parameter $p$ and the Normal CDF. Specifically is the condition $p>\Phi(x)$, where $x$ is drawn from the standard normal ...
2
votes
0answers
50 views

Unknown number of colours Bernoulli Urn

Okay, so, in the traditional Bernoulli Urn problem, we have an urn with a number N, possibly infinite, of coloured balls, and there are k possible colours. That one I grok. However, what if I don't ...
7
votes
2answers
167 views

Estimating successes while obtaining Bernoulli samples

I have a process which, after fixing the values of some parameters, generates samples from a Bernoulli distribution with unknown $p$. The value of $p$ is typically small, and what I want to do is to ...
1
vote
0answers
687 views

What does a confidence interval with a negative endpoint mean?

I have 10 iid r.v. with Bernoulli distribution with $X_{i} = 1$ for a positive result. I'm given $\sum_{i=1}^{10} X_i= 1$ and need to find a two-sided 99% confidence interval for $\theta$. So ...
1
vote
1answer
141 views

Expected value of an indicator function

We have $$ I_i (x) = \begin{cases} 1 \quad x-h<X_i<x+h \\ 0 \quad \text{otherwise} \end{cases} $$ Does that indicator function follow the Bernoulli distribution? If so, the expected value can ...
1
vote
0answers
29 views

Is the mean of n independent Bernoulli random variables normal? [duplicate]

I'm trying to figure out the difference between an A/B split test and an ANOVA test and I came across this article. It suggests that the mean of $n$ independent Bernoulli random variables is normally ...
2
votes
2answers
124 views

Bernoulli Confidence Intervals for p very close to 0

Let's say I have the following observations from many Bernoulli distributions with different p (p1, p2, ..): Observations from Distribution 1: 10 successes, 100,000 trials, p_hat = 0.0001 ...
2
votes
1answer
235 views

p-value of hypothesis “a home court advantage exists”

The practical POV: I sample 35 matches: 15 turn out as home win, 10 as tie and 10 as home lose. I want to conduct a test for the hypothesis "A home court advantage does exist." with a significance ...
2
votes
1answer
102 views

Using cross correlation to infer dependence, can it be done?

I have a very particular question, I have seen a similar one here, but my knowledge is too limited to make use of it. I will try to explain myself as clearly as possible... Wish me luck! I have a ...
3
votes
1answer
206 views

Are $\mathbb{F}_2$-linear combinations of random variables in an i.i.d. Bernoulli process again an i.i.d. Bernoulli process?

I'm having trouble understanding how certain combinations of random variables can correlate. The problem is as follows: I have a binary $m \times n$ matrix $A$ of full rank (over the finite field ...
3
votes
1answer
65 views

Flipping identifiable coins in batches

I have collected data to estimate a parameter and am now puzzled about how to generate confidence intervals: Setup: 1) We have a bag with $N$ coins. 2) Each coin $i \in N$ has a known probability ...
3
votes
2answers
185 views

Significance test for highly skewed Bernoulli distribution

I am working with two highly skewed Bernoulli distributions where 96-99+% of the samples are in the "false" category, and the rest are in the "true" category (sort of speak). I am looking for a ...