Linked Questions

3
votes
2answers
23k views

P-value vs Type 1 Error [duplicate]

I am trying to understand the relationship of a p-value vs Type 1 error rate. My understanding of one interpretation of a p-value is the following: "the p-value tells us the probability of making a ...
1
vote
1answer
1k views

Intuitive explanation of why p is not the probability of the null hypothesis [duplicate]

I've got to teach a basic course on the $\chi^2$ test soon, and I will of course insist on the fact that $p$ is not the probability of the null hypothesis to be true, and that the result of the test ...
2
votes
2answers
455 views

P-Value Clarification [duplicate]

I'm new to P-Values and Hypothesis testing and I noticed that p-values are explained differently everywhere I go. In my lecture notes it has a method for hypothesis testing and the last part says that ...
1
vote
2answers
80 views

Can I think of the level of a hypothesis test as being the probability the null hypothesis is true? [duplicate]

I am trying to understand the level of a test better and was wondering if the level of a hypothesis is essentially equal to the probability that the null hypothesis is true. I have been trying to ...
1
vote
0answers
53 views

Alternate interpretation of p-value [duplicate]

I have got a p-value of .0166 on a hypothesis test on comparison of hourly wages for different countries. Would it be right to make a a conclusive remark that “We can be 98.34% confident [1-.0166] ...
72
votes
4answers
27k views

When to use Fisher and Neyman-Pearson framework?

I've been reading a lot lately about the differences between Fisher's method of hypothesis testing and the Neyman-Pearson school of thought. My question is, ignoring philosophical objections for a ...
56
votes
6answers
3k views

Is the “hybrid” between Fisher and Neyman-Pearson approaches to statistical testing really an “incoherent mishmash”?

There exists a certain school of thought according to which the most widespread approach to statistical testing is a "hybrid" between two approaches: that of Fisher and that of Neyman-Pearson; these ...
29
votes
5answers
1k views

How should an individual researcher think about the false discovery rate?

I've been trying to wrap my head around how the False Discovery Rate (FDR) should inform the conclusions of the individual researcher. For example, if your study is underpowered, should you discount ...
16
votes
4answers
6k views

Misunderstanding a P-value?

So I've been reading a lot about how to correctly interpret a P-value, and from what I've read, the p-value says NOTHING about the probability that the null hypothesis is true or false. However, when ...
10
votes
2answers
27k views

How do I find the probability of a type II error?

I know that a Type II error is where H1 is true, but H0 is not rejected. Question How do I calculate the probability of a Type II error involving a normal distribution, where the standard deviation ...
2
votes
1answer
4k views

How do I interpret the p value returned in scipy's Mann Whitney U test?

I have a program in which I need to perform an action based on what results of a Mann Whitney U test are. I know the criteria that need to be met, but I would still like to understand what the results ...
6
votes
3answers
436 views

Is this a valid way to think about p-values?

Would it be accurate to say that a p-value is a random variable whose null distribution is Unif$(0,1)$ which stochastically dominates its distribution under the alternative hypothesis? I realized that ...
7
votes
1answer
519 views

When does it make sense to reject/accept an hypothesis?

In To P or not to P: on the evidential nature of P-values and their place in scientic inference, Michael Lew has shown that, at least for the t-test, the one-sided p-value and sample size can be ...