Linked Questions

5
votes
3answers
70 views

question about p values and significance comparison [duplicate]

I am under the impression that you have to set your alpha value before the experiment, and once the experiment is done, your p value, based on the alpha value, is either significant or not. It's ...
243
votes
148answers
128k views

Famous statistical quotations

What is your favorite statistical quote? This is community wiki, so please one quote per answer.
53
votes
5answers
3k views

Is the “hybrid” between Fisher and Neyman-Pearson approaches to statistical testing really an “incoherent mishmash”?

There exists a certain school of thought according to which the most widespread approach to statistical testing is a "hybrid" between two approaches: that of Fisher and that of Neyman-Pearson; these ...
35
votes
3answers
7k views

Interpretation of p-value in hypothesis testing

I recently came across the paper "The Insignificance of Null Hypothesis Significance Testing", Jeff Gill (1999). The author raised a few common misconceptions regarding hypothesis testing and p-values,...
29
votes
4answers
3k views

Why are lower p-values not more evidence against the null? Arguments from Johansson 2011

Johansson (2011) in "Hail the impossible: p-values, evidence, and likelihood" (here is also link to the journal) states that lower $p$-values are often considered as stronger evidence against the null....
31
votes
2answers
5k views

Is the exact value of a 'p-value' meaningless?

I had a discussion with a statistician back in 2009 where he stated that the exact value of a p-value is irrelevant: the only thing that is important is whether it is significant or not. I.e. one ...
28
votes
4answers
8k views

Are smaller p-values more convincing?

I've been reading up on $p$-values, type 1 error rates, significance levels, power calculations, effect sizes and the Fisher vs Neyman-Pearson debate. This has left me feeling a bit overwhelmed. I ...
9
votes
6answers
2k views

Using p-value to compute the probability of hypothesis being true; what else is needed?

Question: One common misunderstanding of p-values is that they represent the probability of the null hypothesis being true. I know that's not correct and I know that p-values only represent the ...
17
votes
3answers
3k views

Is it wrong to refer to results as being “highly significant”?

Why do statisticians discourage us from referring to results as "highly significant" when the $p$-value is well below the conventional $\alpha$-level of $0.05$? Is it really wrong to trust a result ...
11
votes
2answers
12k views

Q-Q plot interpretation

Consider the following code and output: ...
6
votes
2answers
877 views

Interpreting p-values in Fisher vs Neyman-Pearson frameworks

I am a little confused about what p-values mean under Fisher's signficance testing & Neyman-Pearson's hypothesis testing. Fisher uses p-values as a continuous measure of evidence against a null ...
5
votes
3answers
3k views

What is the meaning of a large p-value?

I understand that the $p$-value is the conditional probability of observing the test statistic or something more extreme given that the null hypothesis is true. I have read the great explanation by @...
3
votes
2answers
170 views

What really happens when we transform the data using $f(x) = \sin(\sqrt{x})$?

I need to perform a two-way ANOVA on my data ($Y$: sleeping hours). My data is quite normal $p$-value = $0.07$ with Shapiro-Wilk test but when I run the normality test for my residual, $p$-value is ...
6
votes
2answers
1k views

Using multiple comparisons corrections in Fisher p-value framework

I am wary of stepping into the civil war between Fisher vs Neyman-Pearson interpretations of $p$-value (which has been well elucidated here and here), but I've been pondering a question that I keep ...
4
votes
2answers
1k views

Why is Binary Classification not a Hypothesis Test?

I'm having a hard time finding the right way to explain to an engineer friend why binary classification isn't quite the same as a statistical hypothesis test. Clearly, in both cases we are choosing ...

15 30 50 per page