15 votes
Accepted

Can I use p-values without hypothesis?

You can't even calculate p values without a null hypothesis, because this is a crucial ingredient that goes into all tests, along with data and a model specification. For instance, for a t test for a ...
Stephan Kolassa's user avatar
12 votes

Can I use p-values without hypothesis?

Why do you even want a p value when you don't have a hypothesis? But, in short, the answer is "no". I mean, you can't stop the computer from outputting a p value, but, every p value has an ...
Peter Flom's user avatar
  • 110k
5 votes

$p$-value: Fisherian vs. contemporary frequentist definitions

@ShawnHemelstrand's answer contains much of what is needed to get to an understanding of these issues, but there is something that I can add that will help, particularly with issues like those raised ...
Michael Lew's user avatar
  • 13.9k
5 votes

$p$-value: Fisherian vs. contemporary frequentist definitions

Extremity is defined in terms of the density of the test statistic First, $F$ tests and $\chi^2$ tests are typically rejected only for large values of the test statistic. Clearly, in Fisherian ...
Sextus Empiricus's user avatar
4 votes

Permutation test for exponential null hypothesis: really bad?

Edit: This answer doesn't deal with the actual meat of the question, which was about permutation tests. I will either fix it or delete it. The likelihood ratio test looks pretty good to me and ...
Glen_b's user avatar
  • 278k
4 votes

$p$-value: Fisherian vs. contemporary frequentist definitions

Technically there is no contradiction. If you for example look at the one- or two-sided t-test for the $H_0$ of a mean being zero, the two-sided test will measure what's "more extreme" by ...
Christian Hennig's user avatar
2 votes

$p$-value: Fisherian vs. contemporary frequentist definitions

Shawn that is a wonderful answer but it’s important to point out a subtle problem with a small part of it. The “in the long run we should not often be wrong” statement of Neyman and Pearson is an ...
Frank Harrell's user avatar
2 votes

Statistical test for a biology experiment when plants were grown in 3 different solution concentrations

The biomass amounts in grams* over time can be handled by standard methods. Two main predictors would be the caffeine concentrations and whether the source was pure caffeine or coffee grounds. If you ...
EdM's user avatar
  • 86.9k
2 votes

How to evaluate patient significant improvement?

The question seems to conflate functional improvement with some type of statistical improvement. I would like to compute the percentage of patients that got a significant improvement in their holding ...
EdM's user avatar
  • 86.9k

Only top scored, non community-wiki answers of a minimum length are eligible