Questions tagged [neyman-pearson-lemma]
A theorem stating that likelihood ratio test is the most powerful test of point null hypothesis against point alternative hypothesis. DO NOT use this tag for Neyman-Pearson approach to hypothesis testing, this tag is for the lemma only.
101 questions
8
votes
3
answers
570
views
Proof of the statement "the best test is unbiased"
There is a corollary from Hogg and McKean's textbook titled "Introduction to Mathematical Statistics" and I have miserably failed to understand the proof. Unfortunately, my question requires ...
- 86.4k
0
votes
0
answers
28
views
Prove that a test is most powerful when $X_1,\cdots,X_n\sim U(0,\theta)$
Let $X_1,\cdots,X_n\sim U(0,\theta),\theta >0$ be independent random variables. I want to prove that $\phi :\mathbb{R}^n\to [0,1]$ given by $\phi (x):=\begin{cases}1,&\theta _0<x_{(n)}\vee ...
- 163
3
votes
1
answer
90
views
is the likelihood ratio test "best" for finite samples?
Wikipedia says
The Neyman–Pearson lemma states that this likelihood-ratio (lr) test is the most powerful among all level α alpha tests for this case.
Is this only true for infinite sample sizes? Is ...
- 10.3k
3
votes
1
answer
1k
views
Neyman Pearson Lemma and most powerful test
This is a homework question. I was given a random sample of independent and identically distributed $X_i$'s and wish to test the hypotheses:
$$H_0: \theta = \theta_0$$
$\text{vs}$
$$H_A: \theta = \...
- 86.4k
3
votes
1
answer
1k
views
Neyman Pearson lemma for Bernoulli variables
I've been reading up on Neyman Pearson Lemma but don't understand it to its full extent. Could someone please explain to me how to obtain the most powerful test for a sample of Bernoulli variables?
1
vote
1
answer
59
views
General Lower Bound of Power in Neyman-Pearson
Let $X$ be an $\sigma$-finite space $(\mathcal{X}, F_{\mathcal{X}}, \nu)$ valued absolutely continuous random variable whose distribution is one of $P_0 = f_0(x)d\nu(x)$ or $P_1 = f_1(x)d\nu(x)$. We ...
- 3,416
3
votes
1
answer
74
views
Understanding proof of Neyman Pearson Lemma
I am trying to understand Neyman Pearson Lemma's proff from Rice's book. The lemma is intuitive, however I am not able to understand the reasoning for the first inequality in the proof. I highlighted ...
- 121
2
votes
0
answers
41
views
Neyman-Pearson Testing: Swapping the main and alternative hypotheses to ensure P(Type I) < P(Type II)
I have been reading up on hypothesis testing, and realized I misunderstood something, which made me mix Fisher's p-values with Neyman-Pearson's critical regions. I am going to amend that situation, so ...
- 82.7k
0
votes
0
answers
23
views
How does the effect size inform the design (or analysis) of an NHST?
Consider this answer on how to design an NHST. I don't quite understand what exact process one is supposed to follow to determine the minimum sample size once we have:
A null hypothesis that is ...
- 82.7k
4
votes
1
answer
183
views
Finding P-value and power of the Most Powerful Test
You observe a sample $X_1, \quad, X_{20}$ with the density
$$
f(x, \vartheta)=2\left(x / \vartheta^2\right) I_{[0 \leq x<\vartheta]}
$$
with an unknown parameter $\vartheta>0$, yielding
$$
\min \...
- 5,893
1
vote
0
answers
69
views
UMP two sided tests for exponential families
Consider a random variable $X$ with density $$f(x : θ) = C(θ)e^{η(θ)T(x)}h(x), θ ∈ Θ$$.
Assume that $η(θ)$ is strictly increasing in $θ$ and that the family is full rank. Show that there will not be ...
- 82.7k
1
vote
1
answer
63
views
Show a composite test is the most powerful after deriving a similar most powerful simple test
Let $X$ be a real-valued random variable with density $f(x) = (2\theta x + 1 - \theta) \mathbb{1}(x \in [0,1])$ where $1$ here is the indicator function and $-1 < \theta < 1$. I am trying to ...
- 3,416
4
votes
2
answers
2k
views
Does Neyman-Pearson Lemma consider the case when the likelihood ratio equals the critical value?
Here are three different versions of Neyman-Pearson lemma. They differ in that the first two (books) ignore the case when the likelihood ratio equals the critical value, while the last one (Wikipedia) ...
- 10.3k
11
votes
2
answers
2k
views
Why is the Neyman-Pearson lemma a lemma and not a theorem? [duplicate]
This is more of a history question than a technical question.
Why is the ``Neyman-Pearson lemma'' a Lemma and not a Theorem?
link to wiki: https://en.wikipedia.org/wiki/Neyman%E2%80%93Pearson_lemma
...
- 13.3k
0
votes
0
answers
50
views
Is there a uniformly most powerful yet exact test for independence of two categorical variables?
I know that uniformly most powerful tests have to be based on the likelihood ratios as test statistic, which is not the case for the Fisher exact test. Nevertheless couldn't I use the G2 test metric, ...
- 11
7
votes
2
answers
1k
views
Why is Neyman-Pearson lemma a lemma or is it a theorem?
A classical result in statistical theory is the Neyman-Pearson lemma, which not only shows the existence of tests with the most power that return a pre-specified level of Type I error, but also a way ...
- 46.8k
1
vote
1
answer
65
views
Given a UMP test, why does NP lemma deliver the same critical region for all $\theta_1\in\Omega_1? $
I'm unsure why, given a uniformly most powerful test exists, that the Neyman-Pearson lemma delivers the same critical region for all $\theta_1\in \Omega_1.$ Is it because this is the smallest critical ...
- 10.3k
6
votes
2
answers
371
views
Biased coin game
Assume, there's a 50% chance I get a fair coin and 50% I get a biased coin with 0.6 chance of getting heads.
Then, I get to toss the coin I got as many times as I want, but each toss costs a dollar.
...
- 722
4
votes
3
answers
3k
views
UMP for $U(0,\theta)$ (simple x simple hypothesis)
Let $X_1,...,X_n $ be iid $U(0,\theta)$. Find the UMP to test $H_0: \theta = \theta_0$ versus $H_1: \theta=\theta_1$, for $\theta_1 < \theta_0.$ Obtain the power of the test.
My attempt:
We know ...
- 31.6k
1
vote
0
answers
366
views
How to Justify this Two-Sided Test is UMP with NP Lemma?
UMP tests generally do not exist for two sided tests, ie $H_0: \theta = \theta_0$ vs $H_a: \theta \neq \theta_0$. However, if we observe $n$ iid observations of $X\sim Unif(0,\theta)$, we can ...
- 87
4
votes
1
answer
266
views
What is the NP?
Suppose $X_1, X_2, X_3,\ldots, X_n$ are i.i.d. variables Poisson $(\lambda)$
and $g(λ)=\lambda(c - e^{-cλ})$
c:constant
What is the NP for
$H_0:g(λ)=c1$ vs $H_1:g(λ)=c2$ ??
My thought:
...
CommunityBot
- 1
1
vote
1
answer
127
views
Does there always exist for n small, a non-chi-squared test-statistic for the likelihood-ratio (neyman-pearson, karlin-rubin), score, and wald-tests?
An additional reason that the chi-squared distribution is widely used is that it turns up as the large sample distribution of generalized likelihood ratio tests (LRT).[6] LRTs have several desirable ...
CommunityBot
- 1
1
vote
1
answer
713
views
How would you find a p threshold for a binary classification prediction? [duplicate]
Lets say that there's a binary classification problem where $X$ ∈ $R_p$ and $Y ∈ \{0,1\} $ and $Pr(Y = 1 | X = x) = p$ for $p$ in $[0,1]$. There is a loss function $L_{falseneg} > 0$ for false ...
- 82.7k
1
vote
0
answers
95
views
Uniformly most powerful test
Suppose we have Xi~Exp(λ), and we want to construct a most powerful test for
H0 : λ = λ0, H1 : λ = λ1
I then proceed to use the Neyman Pearson lemma : reject H0 when the likelihood ratio L(λ1;X)/L(...
- 185
1
vote
1
answer
79
views
The Test Statistic of the Neyman - Pearson Lemma
I cannot understand this statement from the book Robust Statistics:
The most powerful tests between two densities $p_0$ and $p_1$, are based on a statistic of the form
$$\int \psi F_n(dx) = \frac{1}{n}...
- 333k
1
vote
0
answers
55
views
Neyman-Pearson’s Lemma a to define the rejection region of the type nx > κ Bernoulli [duplicate]
I'm working through the following question:
I understand that the formula is:
Likelihood(Theta_0) / Likelihood(Theta_A)
As its bernoulli, I think it shoudl work out as below but I am at a loss on how ...
- 11
0
votes
0
answers
269
views
Most powerful test for hypothesis testing with uniform and exponential distributions
Given sample of single observation $x_{[1]}$, we are checking hypothesis $H_0 \sim U[0, 1]$ versus $H_1 \sim Exp(1)$. I need to find most powerful test for hypothesis checking with given Type I error ...
- 251
0
votes
0
answers
65
views
Most Powerful Test for random variable with different distributions
The exercise
We have $\Theta = \{0,1\}$ and let $X$ be a random variable with density function $f(x;0)=1$ and $f(x;1)=3x^2$ for $x\in (0,1)$. I want to find the most powerful test of size $\alpha=0.2$ ...
- 8,718
1
vote
1
answer
799
views
randomized Neyman-Pearson lemma for a discrete distribution
We let $\Theta=\{0,1\}$, and $X$ be a discrete R.V with the following probability distribution:
x
1
2
3
4
5
6
7
8
$f(x;0)$
0.02
0.02
0.02
0.02
0.02
0.02
0.02
0.86
$f(x;1)$
0.14
0.12
0.10
0.08
0.06
...
- 8,718
1
vote
0
answers
529
views
Using Neyman Pearson lemma on a two sample test for normal means
Say I have two groups. I collect $n$ data points from the first ($A$) group ($x_i$) and $m$ data points from the second ($B$) group ($y_j$). The null hypothesis is that the means of the two groups are ...
- 2,630
3
votes
1
answer
577
views
Neyman-Pearson Lemma for Pareto Distribution [duplicate]
I have the following problem.
Let $X_1, ..., X_n$ represent a random sample taken from a population with CDF given by
$$
F(x;\beta) = 1 - \frac{\beta}{x}, ~~ x \geq \beta > 0.
$$
Based on the this ...
- 82.7k
4
votes
1
answer
1k
views
Most powerful test of simple vs. simple in $\mathrm{Unif}[0, \theta]$
Say $X \sim \mathrm{Unif}[0, \theta]$. Denote the observations as $x_i$ $(i=1, \cdots, n)$.
Show that any test $\phi$ that satisfies the following two conditions is most powerful test of level $\alpha$...
- 42k
0
votes
0
answers
769
views
Which to Use: Likelihood Ratio Test or Uniformly Most Powerful Test?
I've recently been learning about MPTs (most powerful tests), UMPTs (uniformly most powerful tests) and LRTs (likelihood ratio tests), and do not totally understand in which context the different ...
- 82.7k
2
votes
0
answers
657
views
UMP for Poisson distribution
Let $X_1, \ldots, X_n$ be an iid sample from a Poisson distribution with pmf $f(x; \theta) = \theta^x/x! \cdot e^{-\theta}$ for $x = 0, \ldots$ where $\theta \geq 1$.
I want to come up with an ...
- 121
1
vote
0
answers
216
views
How to combine two independent likelihood ratio tests?
Let us know that a patient has one of disease A or B. Suppose that we run an experiment to find that the patient has disease A or disease B. The null hypothesis is that the patient has disease A and ...
- 21
1
vote
0
answers
254
views
Most Powerful test for indicating exponential or Weibull distribution [closed]
Let $X_1,...,X_n$ be iid distribution function of $F(x)$. I want to test whether $F$ is exponential or Weibull. This means that either $F(x)=1-exp(-x), x>0$ (exponential) $F(x)=1-exp(-x^{\theta}), ...
- 31.6k
0
votes
0
answers
301
views
Neyman-Pearson hypothesis testing and composite alternative hypothesis
I am in love with the idea of setting up a statistical test à la Neyman-Pearson when possible, because it is just so intuitive. Most of times, $H_0$ is some kind of point hypothesis, but $H_1$ is ...
- 225
1
vote
0
answers
49
views
Finding the likelihood ratio to test which distribution has the largest mean
The problem: Let $X_1, \ldots, X_n$ and $Y_1, \ldots, Y_m$ be two i.i.d. samples drawn from $\mathcal{N}(\mu_x, \sigma^2)$ and $\mathcal{N}(\mu_y, \sigma^2)$, respectively. I wanna test $H_0: \mu_x \...
- 1,539
0
votes
0
answers
601
views
Proving a test is UMP for Uniformly distributed random variable
Let $X_1, X_2,..., X_n$ be a sample of size n from the PMF
$$P_N(x) = {1 \over N},\ \ \ \ \ \ \ \ \ x = 1,2,...,N;N \in \mathbb{N} $$
Show that
$$
\varphi(x_1, x_2, ..., x_n) = \begin{cases}
1 & ...
- 101
1
vote
0
answers
20
views
Restricting sets of alternative and null hypotheses to just two values
I have encountered this following question quite a few times in different exercises, and have seen some examples using it, however, in the notes and book that I am following, I am unable to find a ...
1
vote
1
answer
1k
views
Neyman pearson on discrete distribution
I have found the ratio of h1 to h0 and the ratio is increasing .So we should reject H0 for large values of x.How should i find the critical region for such type of questions.It seems to me the ...
- 57.6k
1
vote
1
answer
102
views
A basketball probability question using Neyman–Pearson lemma
It is known that the probability of a basketball player to make his first shot is $p=0.6$
A player argues that it does not matter if he made the previous shot or not his odds stays the same. We say if ...
- 306
1
vote
0
answers
36
views
UMP test equivalence of definitions
I've been revising the past couple of days and have come across $2$ definitions of a UMP test.
Suppose we want to test $H_0: \theta=\theta_0$ vs $H_1: \theta>\theta_0$. Then the test is UMP if:
...
- 82.7k
3
votes
1
answer
1k
views
How can I apply the Neyman-Pearson Lemma for $f(x|\theta)=\frac{1}{2\theta}\exp[-|x|/\theta]$?
Let $X_1,\cdots,X_n$ be a random sample from:
$$f(x|\theta)=\frac{1}{2\theta}\exp[-|x|/\theta]
\quad \quad \quad x \in \mathbb{R},$$
where $\theta>0$ is unknown. How can I find an MP size $\alpha$...
- 133k
0
votes
0
answers
96
views
How can I further reduce my MP size $\alpha$ test given a random sample from a shifted exponential distribution?
Let $X_1,\cdots,X_n$ be a random sample from $f(x|\theta)=e^{-(x-\theta)},x>\theta,$ where $\theta$ is an unknown real number. Find an MP size $\alpha$ test for $H_0:\theta=\theta_0$ v. $H_1:\theta=...
- 2,073
1
vote
1
answer
412
views
Finding Uniformly Most Powerful test
My Attempt
Comparing $f(x;\theta)$ with the form $a(\theta)b(x)exp[c(\theta)d(x)]$ ,
we get $d(x) = log (1-x)$ and $ c(\theta ) = \theta -1 $ as monotone , increasing function in $\theta$ and ...
- 11.6k
0
votes
0
answers
67
views
Is the $p-$value uniformly distributed in this case?
Let $(Ω, A,P)$ be a statistical model, $H_{0} = \{P_{0}\}\subseteq P$ a simple null hypothesis, and $H_{1} = \{P_{1}\} ⊂ P$ a different simple alternative, so that $P_{1}$ with respect to $P_{0}$ has ...
- 139
1
vote
0
answers
136
views
Hypothesis testing - Neyman-Pearson Lemma
While studying for my exam and practicing with old exams I came across this question. In the answer to part d) they mention that both coefficients are positive and hence for some c the test in part b) ...
- 11
0
votes
0
answers
300
views
Finding UMP test when testing a simple hypothesis against a composite hypothesis
Hi all I have question regarding the following when reading the notes on Page 5 here: http://www.ams.sunysb.edu/~zhu/ams571/Lecture8_571.pdf
The question that I have is when the author showed how to ...
- 11.6k
1
vote
0
answers
177
views
Is a best critical region unique?
For testing a simple hypothesis $H_0:\theta=\theta_0$ against another simple hypothesis $H_1: \theta=\theta_1$, a best critical region or a most powerful test of size (aka, significance level) $\alpha$...
- 231