Linked Questions

66 votes
14 answers

If we fail to reject the null hypothesis in a large study, isn't it evidence for the null?

A basic limitation of null hypothesis significance testing is that it does not allow a researcher to gather evidence in favor of the null (Source) I see this claim repeated in multiple places, but I ...
bkoodaa's user avatar
  • 1,299
96 votes
5 answers

When to use Fisher versus Neyman-Pearson framework?

I've been reading a lot lately about the differences between Fisher's method of hypothesis testing and the Neyman-Pearson school of thought. My question is, ignoring philosophical objections, when ...
Stijn's user avatar
  • 1,880
60 votes
4 answers

Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?

Traditional statistical tests, like the two sample t-test, focus on trying to eliminate the hypothesis that there is no difference between a function of two independent samples. Then, we choose a ...
ryu576's user avatar
  • 2,540
55 votes
3 answers

Why does frequentist hypothesis testing become biased towards rejecting the null hypothesis with sufficiently large samples?

I was just reading this article on the Bayes factor for a completely unrelated problem when I stumbled upon this passage Hypothesis testing with Bayes factors is more robust than frequentist ...
Louis Thibault's user avatar
12 votes
1 answer

"Accept null hypothesis" or "fail to reject the null hypothesis"? [duplicate]

I'm trying to conduct a Student's t-test for a table of values while trying to follow the explanation and details found on this website. I understand that if the p-value is <.01 then it's really ...
Richard's user avatar
  • 223
8 votes
1 answer

Does failing to reject the null hypothesis mean rejecting the alternative? [duplicate]

Does "failing to reject" the null hypothesis entails rejecting the alternative one? I think rigorously thinking, we can't, unless alpha is very high.
V_head's user avatar
  • 83
11 votes
2 answers

Can we accept the null in noninferiority tests?

In a usual t-test of means, using the usual hypothesis testing methods, we either reject the null or fail to reject the null but we never accept the null. One reason for this is that if we got more ...
Peter Flom's user avatar
  • 120k
3 votes
3 answers

Why can a likelihood ratio not give evidence for the null since it is a model comparison?

I am curious as to why a likelihood ratio cannot give positive evidence for the null, since it is a model comparison. Indeed, this is more confusing given the fact that Bayes Factors are similar ...
HereItIs's user avatar
  • 121
0 votes
1 answer

Do I want a p-value of 1?

I am doing a biology experiment for the first time, and even though the teacher did not require me to do this, I calculated the p-values for the data on my experiment. They all are above 0.25. From ...
Laura Salas's user avatar
1 vote
0 answers

How to test hypotheses properly? [duplicate]

I have a homepage which I would like to change in some ways. I would like to place a commercial banner on it Ha. In this regard, I dont want the change to affect ...
Mamba's user avatar
  • 295
0 votes
0 answers

Accepting vs failing to accept the null hypothesis? [duplicate]

In this paper the authors state the following regarding a null hypothesis significance test: If P-value < critical value, reject null hypothesis and accept the alternative hypothesis (difference ...
sonicboom's user avatar
  • 940