16k views

### If we fail to reject the null hypothesis in a large study, isn't it evidence for the null?

A basic limitation of null hypothesis significance testing is that it does not allow a researcher to gather evidence in favor of the null (Source) I see this claim repeated in multiple places, but I ...
8k views

### What is a good, convincing example in which p-values are useful?

My question in the title is self explanatory, but I would like to give it some context. The ASA released a statement earlier this week “on p-values: context, process, and purpose”, outlining various ...
6k views

### Is p-value essentially useless and dangerous to use?

This article "The Odds, Continually Updated" from NY Times happened to catch my attention. To be short, it states that [Bayesian statistics] is proving especially useful in approaching complex ...
6k views

### Are effect sizes really superior to p-values?

Lots of emphasis is placed on relying on and reporting effect sizes rather than p-values in applied research (e.g. quotes further below). But is it not the case that an effect size just like a p-...
2k views

### How should an individual researcher think about the false discovery rate?

I've been trying to wrap my head around how the False Discovery Rate (FDR) should inform the conclusions of the individual researcher. For example, if your study is underpowered, should you discount ...
2k views

### Acceptance of null hypothesis

This is a discussion question on the intersection of statistics and other sciences. I often face the same problem: researchers in my field tend to say that there is no effect when the p-value is not ...
5k views

Suppose we have a multiple comparisons scenario such as post hoc inference on pairwise statistics, or like a multiple regression, where we are making a total of $m$ comparisons. Suppose also, that we ...
5k views

### Understanding $\chi^{2}$ and Cramér's $V$ results

I have two groups of buyers, A and B, and I want to test whether the difference between the percentage of them who would buy a ...
13k views

### Is it possible to accept the alternative hypothesis?

I'm aware of several related questions here (e.g., Hypothesis testing terminology surrounding null, Is it possible to prove a null hypothesis?) but I don't know the definitive answer for my question ...
236 views

### Coefficient of 0.001 with p < 0.005 [duplicate]

This should be a simple inquiry. Doing a regression analysis I found that the coefficient of a predictor has a(n) (infinitesimal) positive effect of 0.001 that is significant at the 0.005 level. I ...
468 views

### In what settings would confidence intervals not get better as sample size increases?

In a blog post, I have found the claim that "I believe WG Cochrane the first point out (roughly 1970′s) that with confidence intervals in an observational setting, small sample sizes result in ...
455 views

### Can we accept the null in noninferiority tests?

In a usual t-test of means, using the usual hypothesis testing methods, we either reject the null or fail to reject the null but we never accept the null. One reason for this is that if we got more ...
3k views

### Comparing the mean difference between data measured by different equipment, t-test suitable?

My problem is as follows: I have 2 measuring devices, both using different measuring techniques, each trying to quantify properties of objects passing their measurement area. The devices measure the ...