Linked Questions

81
votes
9answers
18k views

Regarding p-values, why 1% and 5%? Why not 6% or 10%?

Regarding p-values, I am wondering why $1$% and $5$% seem to be the gold standard for "statistical significance". Why not other values, like $6$% or $10$%? Is ...
121
votes
6answers
56k views

Why are p-values uniformly distributed under the null hypothesis?

Recently, I have found in a paper by Klammer, et al. a statement that p-values should be uniformly distributed. I believe the authors, but cannot understand why it is so. Klammer, A. A., Park, C. Y.,...
66
votes
4answers
18k views

How should tiny $p$-values be reported? (and why does R put a minimum on 2.22e-16?)

For some tests in R, there is a lower limit on the p-value calculations of $2.22 \cdot 10^{-16}$. I'm not sure why it's this number, if there is a good reason for ...
76
votes
4answers
28k views

When to use Fisher and Neyman-Pearson framework?

I've been reading a lot lately about the differences between Fisher's method of hypothesis testing and the Neyman-Pearson school of thought. My question is, ignoring philosophical objections for a ...
31
votes
4answers
10k views

Are smaller p-values more convincing?

I've been reading up on $p$-values, type 1 error rates, significance levels, power calculations, effect sizes and the Fisher vs Neyman-Pearson debate. This has left me feeling a bit overwhelmed. I ...
31
votes
3answers
899 views

Accommodating entrenched views of p-values

Sometimes in reports I include a disclaimer about the p-values and other inferential statistics I've provided. I say that since the sample wasn't random, then such statistics would not strictly apply....
5
votes
1answer
2k views

What is an F test?

What is an F test and what does it show? Also what is an alpha, and how do I evaluate the p-value?
0
votes
2answers
7k views

Interpret F-Value in ANOVA [duplicate]

When we conduct an ANOVA, we get F-Value and P-Value. If P-value if smaller than our alpha level of .05 for example, we reject our null hypothesis. What is the importance of F-Value that is obtained ...
3
votes
1answer
4k views

Likert item as independent variable for ANOVA?

I am trying to analyze data based on a sample size of around 50 and would appreciate advice on which statistical test would be most appropriate. Participants, on a single questionnaire, were asked to ...
1
vote
3answers
2k views

Finding the level of significance of a sample

I have an exercise with the following information; $ 20\% $ of the set are youth, my sample of $ 139 $ persons have $ 39 $ youths. The exercise is to test if this sample is a representative sample of ...
1
vote
1answer
121 views

Least Squares Fits to Experimental Data

My attempt at making sense of the problem: The problem provides us with the sum of squares (SS; I believe that's the $18.1$). We can use the SS along with the number of samples $(21)$ to get the ...
1
vote
0answers
23 views

Upsides of reporting a lower or upper bound vs. reporting the actual value [duplicate]

I often see research papers reporting lower or upper bounds. E.g.: Patients treated with the splint regained mobility significantly more quickly (p less than 0.001) and preferred the splint to the ...