Skip to main content

Questions tagged [neyman-pearson-lemma]

A theorem stating that likelihood ratio test is the most powerful test of point null hypothesis against point alternative hypothesis. DO NOT use this tag for Neyman-Pearson approach to hypothesis testing, this tag is for the lemma only.

Filter by
Sorted by
Tagged with
0 votes
1 answer
43 views

General Lower Bound of Power in Neyman-Pearson

Let $X$ be an $\sigma$-finite space $(\mathcal{X}, F_{\mathcal{X}}, \nu)$ valued absolutely continuous random variable whose distribution is one of $P_0 = f_0(x)d\nu(x)$ or $P_1 = f_1(x)d\nu(x)$. We ...
温泽海's user avatar
  • 391
3 votes
1 answer
46 views

Understanding proof of Neyman Pearson Lemma

I am trying to understand Neyman Pearson Lemma's proff from Rice's book. The lemma is intuitive, however I am not able to understand the reasoning for the first inequality in the proof. I highlighted ...
user1953366's user avatar
1 vote
0 answers
24 views

Neyman-Pearson Testing: Swapping the main and alternative hypotheses to ensure P(Type I) < P(Type II)

I have been reading up on hypothesis testing, and realized I misunderstood something, which made me mix Fisher's p-values with Neyman-Pearson's critical regions. I am going to amend that situation, so ...
W_vH's user avatar
  • 176
4 votes
1 answer
156 views

Finding P-value and power of the Most Powerful Test

You observe a sample $X_1, \quad, X_{20}$ with the density $$ f(x, \vartheta)=2\left(x / \vartheta^2\right) I_{[0 \leq x<\vartheta]} $$ with an unknown parameter $\vartheta>0$, yielding $$ \min \...
Stats_Rock's user avatar
0 votes
0 answers
27 views

UMP two sided tests for exponential families

Consider a random variable $X$ with density $$f(x : θ) = C(θ)e^{η(θ)T(x)}h(x), θ ∈ Θ$$. Assume that $η(θ)$ is strictly increasing in $θ$ and that the family is full rank. Show that there will not be ...
user671269's user avatar
1 vote
1 answer
48 views

Show a composite test is the most powerful after deriving a similar most powerful simple test

Let $X$ be a real-valued random variable with density $f(x) = (2\theta x + 1 - \theta) \mathbb{1}(x \in [0,1])$ where $1$ here is the indicator function and $-1 < \theta < 1$. I am trying to ...
Featherball's user avatar
0 votes
0 answers
43 views

Is there a uniformly most powerful yet exact test for independence of two categorical variables?

I know that uniformly most powerful tests have to be based on the likelihood ratios as test statistic, which is not the case for the Fisher exact test. Nevertheless couldn't I use the G2 test metric, ...
giantsqueed's user avatar
6 votes
2 answers
1k views

Why is Neyman-Pearson lemma a lemma or is it a theorem?

A classical result in statistical theory is the Neyman-Pearson lemma, which not only shows the existence of tests with the most power that return a pre-specified level of Type I error, but also a way ...
Tom Chen's user avatar
  • 611
6 votes
2 answers
335 views

Biased coin game

Assume, there's a 50% chance I get a fair coin and 50% I get a biased coin with 0.6 chance of getting heads. Then, I get to toss the coin I got as many times as I want, but each toss costs a dollar. ...
Terklton's user avatar
1 vote
0 answers
252 views

How to Justify this Two-Sided Test is UMP with NP Lemma?

UMP tests generally do not exist for two sided tests, ie $H_0: \theta = \theta_0$ vs $H_a: \theta \neq \theta_0$. However, if we observe $n$ iid observations of $X\sim Unif(0,\theta)$, we can ...
s l's user avatar
  • 87
1 vote
1 answer
58 views

Given a UMP test, why does NP lemma deliver the same critical region for all $\theta_1\in\Omega_1? $

I'm unsure why, given a uniformly most powerful test exists, that the Neyman-Pearson lemma delivers the same critical region for all $\theta_1\in \Omega_1.$ Is it because this is the smallest critical ...
Sam Connell's user avatar
1 vote
1 answer
112 views

Does there always exist for n small, a non-chi-squared test-statistic for the likelihood-ratio (neyman-pearson, karlin-rubin), score, and wald-tests?

An additional reason that the chi-squared distribution is widely used is that it turns up as the large sample distribution of generalized likelihood ratio tests (LRT).[6] LRTs have several desirable ...
user avatar
1 vote
0 answers
85 views

Uniformly most powerful test

Suppose we have Xi~Exp(λ), and we want to construct a most powerful test for H0 : λ = λ0, H1 : λ = λ1 I then proceed to use the Neyman Pearson lemma : reject H0 when the likelihood ratio L(λ1;X)/L(...
jojorabbit's user avatar
1 vote
1 answer
76 views

The Test Statistic of the Neyman - Pearson Lemma

I cannot understand this statement from the book Robust Statistics: The most powerful tests between two densities $p_0$ and $p_1$, are based on a statistic of the form $$\int \psi F_n(dx) = \frac{1}{n}...
user's user avatar
  • 229
1 vote
0 answers
46 views

Neyman-Pearson’s Lemma a to define the rejection region of the type nx > κ Bernoulli [duplicate]

I'm working through the following question: I understand that the formula is: Likelihood(Theta_0) / Likelihood(Theta_A) As its bernoulli, I think it shoudl work out as below but I am at a loss on how ...
Luke's user avatar
  • 11
0 votes
0 answers
244 views

Most powerful test for hypothesis testing with uniform and exponential distributions

Given sample of single observation $x_{[1]}$, we are checking hypothesis $H_0 \sim U[0, 1]$ versus $H_1 \sim Exp(1)$. I need to find most powerful test for hypothesis checking with given Type I error ...
taciturno's user avatar
  • 241
0 votes
0 answers
65 views

Most Powerful Test for random variable with different distributions

The exercise We have $\Theta = \{0,1\}$ and let $X$ be a random variable with density function $f(x;0)=1$ and $f(x;1)=3x^2$ for $x\in (0,1)$. I want to find the most powerful test of size $\alpha=0.2$ ...
Joe's user avatar
  • 85
1 vote
1 answer
671 views

randomized Neyman-Pearson lemma for a discrete distribution

We let $\Theta=\{0,1\}$, and $X$ be a discrete R.V with the following probability distribution: x 1 2 3 4 5 6 7 8 $f(x;0)$ 0.02 0.02 0.02 0.02 0.02 0.02 0.02 0.86 $f(x;1)$ 0.14 0.12 0.10 0.08 0.06 ...
Joe's user avatar
  • 85
1 vote
0 answers
460 views

Using Neyman Pearson lemma on a two sample test for normal means

Say I have two groups. I collect $n$ data points from the first ($A$) group ($x_i$) and $m$ data points from the second ($B$) group ($y_j$). The null hypothesis is that the means of the two groups are ...
ryu576's user avatar
  • 2,540
0 votes
0 answers
661 views

Which to Use: Likelihood Ratio Test or Uniformly Most Powerful Test?

I've recently been learning about MPTs (most powerful tests), UMPTs (uniformly most powerful tests) and LRTs (likelihood ratio tests), and do not totally understand in which context the different ...
Academic005's user avatar
2 votes
0 answers
584 views

UMP for Poisson distribution

Let $X_1, \ldots, X_n$ be an iid sample from a Poisson distribution with pmf $f(x; \theta) = \theta^x/x! \cdot e^{-\theta}$ for $x = 0, \ldots$ where $\theta \geq 1$. I want to come up with an ...
hama's user avatar
  • 121
1 vote
0 answers
179 views

How to combine two independent likelihood ratio tests?

Let us know that a patient has one of disease A or B. Suppose that we run an experiment to find that the patient has disease A or disease B. The null hypothesis is that the patient has disease A and ...
Amir's user avatar
  • 21
1 vote
0 answers
231 views

Most Powerful test for indicating exponential or Weibull distribution [closed]

Let $X_1,...,X_n$ be iid distribution function of $F(x)$. I want to test whether $F$ is exponential or Weibull. This means that either $F(x)=1-exp(-x), x>0$ (exponential) $F(x)=1-exp(-x^{\theta}), ...
statwoman's user avatar
  • 663
1 vote
1 answer
686 views

How would you find a p threshold for a binary classification prediction? [duplicate]

Lets say that there's a binary classification problem where $X$ ∈ $R_p$ and $Y ∈ \{0,1\} $ and $Pr(Y = 1 | X = x) = p$ for $p$ in $[0,1]$. There is a loss function $L_{falseneg} > 0$ for false ...
321ahno's user avatar
  • 11
0 votes
0 answers
264 views

Neyman-Pearson hypothesis testing and composite alternative hypothesis

I am in love with the idea of setting up a statistical test à la Neyman-Pearson when possible, because it is just so intuitive. Most of times, $H_0$ is some kind of point hypothesis, but $H_1$ is ...
marco's user avatar
  • 215
1 vote
0 answers
48 views

Finding the likelihood ratio to test which distribution has the largest mean

The problem: Let $X_1, \ldots, X_n$ and $Y_1, \ldots, Y_m$ be two i.i.d. samples drawn from $\mathcal{N}(\mu_x, \sigma^2)$ and $\mathcal{N}(\mu_y, \sigma^2)$, respectively. I wanna test $H_0: \mu_x \...
WHoZ's user avatar
  • 66
3 votes
1 answer
540 views

Neyman-Pearson Lemma for Pareto Distribution [duplicate]

I have the following problem. Let $X_1, ..., X_n$ represent a random sample taken from a population with CDF given by $$ F(x;\beta) = 1 - \frac{\beta}{x}, ~~ x \geq \beta > 0. $$ Based on the this ...
Sigma's user avatar
  • 569
0 votes
0 answers
569 views

Proving a test is UMP for Uniformly distributed random variable

Let $X_1, X_2,..., X_n$ be a sample of size n from the PMF $$P_N(x) = {1 \over N},\ \ \ \ \ \ \ \ \ x = 1,2,...,N;N \in \mathbb{N} $$ Show that $$ \varphi(x_1, x_2, ..., x_n) = \begin{cases} 1 & ...
AxyuS's user avatar
  • 101
1 vote
0 answers
20 views

Restricting sets of alternative and null hypotheses to just two values

I have encountered this following question quite a few times in different exercises, and have seen some examples using it, however, in the notes and book that I am following, I am unable to find a ...
Probability-Stats-Optimisation's user avatar
0 votes
0 answers
18 views

How does the effect size inform the design (or analysis) of an NHST?

Consider this answer on how to design an NHST. I don't quite understand what exact process one is supposed to follow to determine the minimum sample size once we have: A null hypothesis that is ...
Josh's user avatar
  • 4,468
1 vote
1 answer
100 views

A basketball probability question using Neyman–Pearson lemma

It is known that the probability of a basketball player to make his first shot is $p=0.6$ A player argues that it does not matter if he made the previous shot or not his odds stays the same. We say if ...
Roi Hezkiyahu's user avatar
1 vote
1 answer
1k views

Neyman pearson on discrete distribution

I have found the ratio of h1 to h0 and the ratio is increasing .So we should reject H0 for large values of x.How should i find the critical region for such type of questions.It seems to me the ...
Daksh chirantan's user avatar
1 vote
0 answers
35 views

UMP test equivalence of definitions

I've been revising the past couple of days and have come across $2$ definitions of a UMP test. Suppose we want to test $H_0: \theta=\theta_0$ vs $H_1: \theta>\theta_0$. Then the test is UMP if: ...
asdf's user avatar
  • 384
3 votes
1 answer
1k views

How can I apply the Neyman-Pearson Lemma for $f(x|\theta)=\frac{1}{2\theta}\exp[-|x|/\theta]$?

Let $X_1,\cdots,X_n$ be a random sample from: $$f(x|\theta)=\frac{1}{2\theta}\exp[-|x|/\theta] \quad \quad \quad x \in \mathbb{R},$$ where $\theta>0$ is unknown. How can I find an MP size $\alpha$...
Ron Snow's user avatar
  • 2,139
0 votes
0 answers
94 views

How can I further reduce my MP size $\alpha$ test given a random sample from a shifted exponential distribution?

Let $X_1,\cdots,X_n$ be a random sample from $f(x|\theta)=e^{-(x-\theta)},x>\theta,$ where $\theta$ is an unknown real number. Find an MP size $\alpha$ test for $H_0:\theta=\theta_0$ v. $H_1:\theta=...
Ron Snow's user avatar
  • 2,139
1 vote
1 answer
393 views

Finding Uniformly Most Powerful test

My Attempt Comparing $f(x;\theta)$ with the form $a(\theta)b(x)exp[c(\theta)d(x)]$ , we get $d(x) = log (1-x)$ and $ c(\theta ) = \theta -1 $ as monotone , increasing function in $\theta$ and ...
napoleon's user avatar
  • 123
0 votes
0 answers
64 views

Is the $p-$value uniformly distributed in this case?

Let $(Ω, A,P)$ be a statistical model, $H_{0} = \{P_{0}\}\subseteq P$ a simple null hypothesis, and $H_{1} = \{P_{1}\} ⊂ P$ a different simple alternative, so that $P_{1}$ with respect to $P_{0}$ has ...
MinaThuma's user avatar
  • 139
1 vote
0 answers
130 views

Hypothesis testing - Neyman-Pearson Lemma

While studying for my exam and practicing with old exams I came across this question. In the answer to part d) they mention that both coefficients are positive and hence for some c the test in part b) ...
Boyd Werkman's user avatar
1 vote
0 answers
151 views

Is a best critical region unique?

For testing a simple hypothesis $H_0:\theta=\theta_0$ against another simple hypothesis $H_1: \theta=\theta_1$, a best critical region or a most powerful test of size (aka, significance level) $\alpha$...
Tony B's user avatar
  • 220
0 votes
0 answers
284 views

Finding UMP test when testing a simple hypothesis against a composite hypothesis

Hi all I have question regarding the following when reading the notes on Page 5 here: http://www.ams.sunysb.edu/~zhu/ams571/Lecture8_571.pdf The question that I have is when the author showed how to ...
john_w's user avatar
  • 649
0 votes
1 answer
61 views

Finding the NP test

I am really interested on solving the following problem I found in the Casella and Berger. Suppose we have the following pdf: 2$\theta x + 2(1-\theta)(1-x)$ where $ 0<x<1$ and $0<\theta<...
Luis's user avatar
  • 1
3 votes
3 answers
152 views

Can the alternative hypothesis depend on the sample size?

Suppose that we want to test: $$H_0: \theta = 0 \,\,\, vs. \,\,\, H_1:\theta = 1/n,$$ where $n$ is the sample size used to test the hypothesis, and the sample used for this is $X_i \sim f(;\theta)$. ...
Person's user avatar
  • 31
1 vote
0 answers
89 views

Understanding the general theory proposed by Neyman & Pearson

I'm reading Neyman & Pearson, 1933, i.e. Neyman and Pearson. On the problem of the most efficient tests of statistical hypotheses. Philosophical Transactions of the Royal Society of London. ...
nalzok's user avatar
  • 1,787
0 votes
1 answer
306 views

Constant value in Neyman Pearson lemma

To know the k value in Neyman Pearson lemma, do we need to know the alternate hypothesis. To what I understood (from articles like PenStateNotes), we could get value of k using null hypothesis and the ...
kg__'s user avatar
  • 63
4 votes
1 answer
259 views

What is the NP?

Suppose $X_1, X_2, X_3,\ldots, X_n$ are i.i.d. variables Poisson $(\lambda)$ and $g(λ)=\lambda(c - e^{-cλ})$ c:constant What is the NP for $H_0:g(λ)=c1$ vs $H_1:g(λ)=c2$ ?? My thought: ...
GAGA's user avatar
  • 323
1 vote
0 answers
110 views

Likelihood ratio test and sample statistics

Given a sample $\mathbf X =(X_1,...,X_n)$ from a parent random variable $X$, Neyman-Pearson's test for two point hypotheses $H_0$ and $H_1$ is the one defined by the critical region $$C=\left\{\mathbf ...
renyhp's user avatar
  • 121
1 vote
0 answers
116 views

UMP test for $H_0:p=0.5$ vs $H_1:p\neq0.5$?

Let $X_1,\dots, X_n$ Bernoulli trials. I know that the UMP tests for $$H_0:p=0.5 \quad\text{vs}\quad H_1:p>0.5$$ and $$H_0:p=0.5 \quad\text{vs}\quad H_1:p<0.5$$ can be obtained with the Neyman ...
Pawa's user avatar
  • 11
11 votes
2 answers
1k views

Why is the Neyman-Pearson lemma a lemma and not a theorem? [duplicate]

This is more of a history question than a technical question. Why is the ``Neyman-Pearson lemma'' a Lemma and not a Theorem? link to wiki: https://en.wikipedia.org/wiki/Neyman%E2%80%93Pearson_lemma ...
Tauto's user avatar
  • 113
9 votes
1 answer
720 views

Reproduce figure of "Computer Age Statistical Inference" from Efron and Hastie

The summarized version of my question (26th December 2018) I am trying to reproduce Figure 2.2 from Computer Age Statistical Inference by Efron and Hastie, but for some reason that I'm not able to ...
Francisco Fonseca's user avatar
3 votes
0 answers
790 views

Understanding Uniformly Most Powerful vs Uniformly Most Powerful Unbiased tests

I am struggling a little to understand the difference between these two classes of tests. Suppose we were testing a simple null hypothesis and a composite two sided alternative hypothesis. I am ...
jacob's user avatar
  • 459