Linked Questions
33 questions linked to/from When to use Fisher versus Neyman-Pearson framework?
6
votes
3
answers
7k
views
What is the meaning of a large p-value?
I understand that the $p$-value is the conditional probability of observing the test statistic or something more extreme given that the null hypothesis is true. I have read the great explanation by @...
- 569
10
votes
1
answer
1k
views
Does failure to reject the null in Neyman-Pearson approach mean that one should "accept" it?
Based on Neyman-Pearson Hypothesis Testing Theory, will the failure to reject a null hypothesis imply that one should accept the null hypothesis?
(It would be absolutely absurd to have this claim if ...
- 327
4
votes
2
answers
234
views
What really happens when we transform the data using $f(x) = \sin(\sqrt{x})$?
I need to perform a two-way ANOVA on my data ($Y$: sleeping hours). My data is quite normal $p$-value = $0.07$ with Shapiro-Wilk test but when I run the normality test for my residual, $p$-value is ...
- 195
8
votes
3
answers
250
views
Why are Type-II errors in hypothesis testing considered to be errors?
I am reading about decision errors in hypothesis testing. My question is why is a "Type-II error" considered to be an error at all? From what I understand, it arises when we fail to reject a false ...
- 81
6
votes
2
answers
1k
views
How to report general precision in estimating correlations within a context of justifying sample size?
I have a study with 130 participants where most of my analyses involve examining the relative size of correlations between various psychological variables. I'm trying to comply with recommendations ...
- 91
13
votes
1
answer
1k
views
When can't frequentist sampling distribution be interpreted as Bayesian posterior in regression settings?
My actual questions are in the last two paragraphs, but to motivate them:
If I am attempting to estimate the mean of a random variable that follows a Normal distribution with a known variance, I've ...
- 483
1
vote
2
answers
5k
views
For what p-values can you say the data approached significance?
I am in the field of clinical psychology, where statistical significance is commonly said compared to p = .05. For what values of p can I say data APPROACHED significance?
- 129
8
votes
1
answer
1k
views
Difference between the Fisherian and Neymanian methods for causal inference?
I am wondering if anyone would have a succinct way of describing the differences between the two. My understanding is that the Fisherian way is non-parametric and relies on the randomization test to ...
- 4,260
2
votes
1
answer
1k
views
Accept null hypothesis with uncertainty
I have data on weight of a group of people after and before a diet. I want to see if weight loss is distributed normally.
...
- 569
0
votes
1
answer
249
views
Is p-value involved in Neyman-Pearson Testing procedure?
It seems to me that, after having a predetermined level of significance, the Neyman-Pearson approach only requires to see if the observed $x$ lies in the rejection region or not. In this case, how can ...
- 93
2
votes
1
answer
146
views
Are Fisher's tests of significance mathematically correct?
I think of Fisher's approach like this:
We choose a test statistic whose distribution is calculated under H0. H0 being a simple hypothesis of preference
We break down the distribution according to ...
- 21
3
votes
1
answer
138
views
What p value did this study most likely use?
A study I’ve read shows that all of the results relevant to me were at >0.1 p value. Does it mean that the study used a <0.1 p value as significant? Is there still at possibility the study ...
6
votes
1
answer
145
views
What is a good real-life example of using correctly the Neyman-Pearson hypothesis testing framework?
I've read a couple of theoretical explanations of what it is (in particular this thread: When to use Fisher versus Neyman-Pearson framework?), but so far I didn't find real-life examples of people ...
- 357
1
vote
1
answer
276
views
Interpreting 1-sample t-test results
I have a question around interpretation of results of 1-sample t-test. I am using the test (with SciPy.stats.ttest_1samp function in Python) to check if the existing goal set for a productivity metric ...
- 13
2
votes
2
answers
42
views
Why can we draw a more precise conclusion when we choose a lower accepted-risk in this hypothesis-testing setting, which seems contradictory?
We want to know if 100 integer values (in a vector X) are following a Poisson $P(\lambda=2)$ distribution, which is our $H_0$ hypothesis.
Let's say the observed ...
- 622