Linked Questions

66 votes
14 answers
23k views

If we fail to reject the null hypothesis in a large study, isn't it evidence for the null?

A basic limitation of null hypothesis significance testing is that it does not allow a researcher to gather evidence in favor of the null (Source) I see this claim repeated in multiple places, but I ...
bkoodaa's user avatar
  • 1,299
96 votes
5 answers
35k views

When to use Fisher versus Neyman-Pearson framework?

I've been reading a lot lately about the differences between Fisher's method of hypothesis testing and the Neyman-Pearson school of thought. My question is, ignoring philosophical objections, when ...
Stijn's user avatar
  • 1,880
60 votes
4 answers
20k views

Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?

Traditional statistical tests, like the two sample t-test, focus on trying to eliminate the hypothesis that there is no difference between a function of two independent samples. Then, we choose a ...
ryu576's user avatar
  • 2,540
55 votes
3 answers
7k views

Why does frequentist hypothesis testing become biased towards rejecting the null hypothesis with sufficiently large samples?

I was just reading this article on the Bayes factor for a completely unrelated problem when I stumbled upon this passage Hypothesis testing with Bayes factors is more robust than frequentist ...
Louis Thibault's user avatar
12 votes
1 answer
129k views

"Accept null hypothesis" or "fail to reject the null hypothesis"? [duplicate]

I'm trying to conduct a Student's t-test for a table of values while trying to follow the explanation and details found on this website. I understand that if the p-value is <.01 then it's really ...
Richard's user avatar
  • 223
8 votes
1 answer
2k views

Does failing to reject the null hypothesis mean rejecting the alternative? [duplicate]

Does "failing to reject" the null hypothesis entails rejecting the alternative one? I think rigorously thinking, we can't, unless alpha is very high.
V_head's user avatar
  • 83
11 votes
2 answers
562 views

Can we accept the null in noninferiority tests?

In a usual t-test of means, using the usual hypothesis testing methods, we either reject the null or fail to reject the null but we never accept the null. One reason for this is that if we got more ...
Peter Flom's user avatar
  • 120k
3 votes
3 answers
148 views

Why can a likelihood ratio not give evidence for the null since it is a model comparison?

I am curious as to why a likelihood ratio cannot give positive evidence for the null, since it is a model comparison. Indeed, this is more confusing given the fact that Bayes Factors are similar ...
HereItIs's user avatar
  • 121
0 votes
1 answer
79 views

Do I want a p-value of 1?

I am doing a biology experiment for the first time, and even though the teacher did not require me to do this, I calculated the p-values for the data on my experiment. They all are above 0.25. From ...
Laura Salas's user avatar
1 vote
0 answers
43 views

How to test hypotheses properly? [duplicate]

I have a homepage which I would like to change in some ways. I would like to place a commercial banner on it Ha. In this regard, I dont want the change to affect ...
Mamba's user avatar
  • 295
0 votes
0 answers
34 views

Accepting vs failing to accept the null hypothesis? [duplicate]

In this paper the authors state the following regarding a null hypothesis significance test: If P-value < critical value, reject null hypothesis and accept the alternative hypothesis (difference ...
sonicboom's user avatar
  • 940