15
votes
Accepted
Can I use p-values without hypothesis?
You can't even calculate p values without a null hypothesis, because this is a crucial ingredient that goes into all tests, along with data and a model specification.
For instance, for a t test for a ...
12
votes
Can I use p-values without hypothesis?
Why do you even want a p value when you don't have a hypothesis?
But, in short, the answer is "no". I mean, you can't stop the computer from outputting a p value, but, every p value has an ...
5
votes
$p$-value: Fisherian vs. contemporary frequentist definitions
@ShawnHemelstrand's answer contains much of what is needed to get to an understanding of these issues, but there is something that I can add that will help, particularly with issues like those raised ...
5
votes
$p$-value: Fisherian vs. contemporary frequentist definitions
Extremity is defined in terms of the density of the test statistic
First, $F$ tests and $\chi^2$ tests are typically rejected only for large values of the test statistic. Clearly, in Fisherian ...
4
votes
Permutation test for exponential null hypothesis: really bad?
Edit: This answer doesn't deal with the actual meat of the question, which was about permutation tests. I will either fix it or delete it.
The likelihood ratio test looks pretty good to me and ...
4
votes
$p$-value: Fisherian vs. contemporary frequentist definitions
Technically there is no contradiction. If you for example look at the one- or two-sided t-test for the $H_0$ of a mean being zero, the two-sided test will measure what's "more extreme" by ...
2
votes
$p$-value: Fisherian vs. contemporary frequentist definitions
Shawn that is a wonderful answer but it’s important to point out a subtle problem with a small part of it. The “in the long run we should not often be wrong” statement of Neyman and Pearson is an ...
2
votes
Statistical test for a biology experiment when plants were grown in 3 different solution concentrations
The biomass amounts in grams* over time can be handled by standard methods.
Two main predictors would be the caffeine concentrations and whether the source was pure caffeine or coffee grounds. If you ...
2
votes
How to evaluate patient significant improvement?
The question seems to conflate functional improvement with some type of statistical improvement.
I would like to compute the percentage of patients that got a significant improvement in their holding ...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
statistical-significance × 6318hypothesis-testing × 1856
regression × 623
r × 578
t-test × 560
p-value × 553
anova × 358
mathematical-statistics × 351
chi-squared-test × 297
machine-learning × 290
correlation × 290
time-series × 266
inference × 248
confidence-interval × 242
distributions × 207
probability × 187
multiple-comparisons × 183
descriptive-statistics × 169
multiple-regression × 158
experiment-design × 151
logistic × 150
categorical-data × 137
self-study × 131
statistical-power × 128
sample-size × 121