15
votes
Accepted
Can I use p-values without hypothesis?
You can't even calculate p values without a null hypothesis, because this is a crucial ingredient that goes into all tests, along with data and a model specification.
For instance, for a t test for a ...
- 118k
12
votes
Can I use p-values without hypothesis?
Why do you even want a p value when you don't have a hypothesis?
But, in short, the answer is "no". I mean, you can't stop the computer from outputting a p value, but, every p value has an ...
- 110k
5
votes
$p$-value: Fisherian vs. contemporary frequentist definitions
@ShawnHemelstrand's answer contains much of what is needed to get to an understanding of these issues, but there is something that I can add that will help, particularly with issues like those raised ...
- 13.9k
5
votes
$p$-value: Fisherian vs. contemporary frequentist definitions
Extremity is defined in terms of the density of the test statistic
First, $F$ tests and $\chi^2$ tests are typically rejected only for large values of the test statistic. Clearly, in Fisherian ...
- 71.9k
4
votes
Permutation test for exponential null hypothesis: really bad?
Edit: This answer doesn't deal with the actual meat of the question, which was about permutation tests. I will either fix it or delete it.
The likelihood ratio test looks pretty good to me and ...
- 278k
4
votes
$p$-value: Fisherian vs. contemporary frequentist definitions
Technically there is no contradiction. If you for example look at the one- or two-sided t-test for the $H_0$ of a mean being zero, the two-sided test will measure what's "more extreme" by ...
- 21.2k
2
votes
$p$-value: Fisherian vs. contemporary frequentist definitions
Shawn that is a wonderful answer but it’s important to point out a subtle problem with a small part of it. The “in the long run we should not often be wrong” statement of Neyman and Pearson is an ...
- 86.9k
2
votes
Statistical test for a biology experiment when plants were grown in 3 different solution concentrations
The biomass amounts in grams* over time can be handled by standard methods.
Two main predictors would be the caffeine concentrations and whether the source was pure caffeine or coffee grounds. If you ...
- 86.9k
2
votes
How to evaluate patient significant improvement?
The question seems to conflate functional improvement with some type of statistical improvement.
I would like to compute the percentage of patients that got a significant improvement in their holding ...
- 86.9k
Only top scored, non community-wiki answers of a minimum length are eligible