Linked Questions

1
vote
0answers
58 views

Meaning of significance test [duplicate]

I was wondering what relation and differences are between a significance test and a hypothesis test? Are they the same concept, or is the former a special case of the latter, or ...? What does a ...
14
votes
5answers
7k views

Are effect sizes really superior to p-values?

Lots of emphasis is placed on relying on and reporting effect sizes rather than p-values in applied research (e.g. quotes further below). But is it not the case that an effect size just like a p-...
31
votes
5answers
2k views

How should an individual researcher think about the false discovery rate?

I've been trying to wrap my head around how the False Discovery Rate (FDR) should inform the conclusions of the individual researcher. For example, if your study is underpowered, should you discount ...
7
votes
2answers
2k views

General guidelines on how to derive a hypothesis statistical test?

In general, the process of hypothesis testing can be divided in 4 steps: Formulate the practical problem in terms of hypotheses. Calculate a statistic $T$, a function purely of the data. All good ...
6
votes
3answers
478 views

Is this a valid way to think about p-values?

Would it be accurate to say that a p-value is a random variable whose null distribution is Unif$(0,1)$ which stochastically dominates its distribution under the alternative hypothesis? I realized that ...
7
votes
1answer
532 views

When does it make sense to reject/accept an hypothesis?

In To P or not to P: on the evidential nature of P-values and their place in scientic inference, Michael Lew has shown that, at least for the t-test, the one-sided p-value and sample size can be ...
10
votes
1answer
233 views

What's the distinction between a “Null hypothesis statistical test” and any other test?

A recent hot topic of discussion concerns a journal banning the use of "null hypothesis statistical testing procedures (NHSTPs)" from articles submitted to the journal. I see this term used by some ...
1
vote
0answers
181 views

The difference between the Frequentist, Bayesian and Fisherian appraoches to statistical inference [duplicate]

I'm just trying to get my head around the differences between these three approaches to statistical inference. I'm just not entirely sure what the significant differences are between the three.
4
votes
0answers
63 views

Justification for reporting non-significant effect sizes

We recently received peer review on a manuscript that contained reasonable feedback but also this item: when the p-value is larger than the alpha level chosen (here is .05), it is not necessary to ...
2
votes
0answers
17 views

Multiple hypothesis tests before and after data collection

My professor asked the following problem to drill in the ideas of significance levels and $p$-values during lectures and it's really doing my head in. Suppose I want to test a particular hypothesis $...