58 views

### Meaning of significance test [duplicate]

I was wondering what relation and differences are between a significance test and a hypothesis test? Are they the same concept, or is the former a special case of the latter, or ...? What does a ...
7k views

### Are effect sizes really superior to p-values?

Lots of emphasis is placed on relying on and reporting effect sizes rather than p-values in applied research (e.g. quotes further below). But is it not the case that an effect size just like a p-...
2k views

### How should an individual researcher think about the false discovery rate?

I've been trying to wrap my head around how the False Discovery Rate (FDR) should inform the conclusions of the individual researcher. For example, if your study is underpowered, should you discount ...
2k views

### General guidelines on how to derive a hypothesis statistical test?

In general, the process of hypothesis testing can be divided in 4 steps: Formulate the practical problem in terms of hypotheses. Calculate a statistic $T$, a function purely of the data. All good ...
478 views

### Is this a valid way to think about p-values?

Would it be accurate to say that a p-value is a random variable whose null distribution is Unif$(0,1)$ which stochastically dominates its distribution under the alternative hypothesis? I realized that ...
532 views

### When does it make sense to reject/accept an hypothesis?

In To P or not to P: on the evidential nature of P-values and their place in scientic inference, Michael Lew has shown that, at least for the t-test, the one-sided p-value and sample size can be ...
233 views

### What's the distinction between a “Null hypothesis statistical test” and any other test?

A recent hot topic of discussion concerns a journal banning the use of "null hypothesis statistical testing procedures (NHSTPs)" from articles submitted to the journal. I see this term used by some ...
181 views

### The difference between the Frequentist, Bayesian and Fisherian appraoches to statistical inference [duplicate]

I'm just trying to get my head around the differences between these three approaches to statistical inference. I'm just not entirely sure what the significant differences are between the three.
My professor asked the following problem to drill in the ideas of significance levels and $p$-values during lectures and it's really doing my head in. Suppose I want to test a particular hypothesis \$...