Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 28288

Hypothesis testing assesses whether data are inconsistent with a given hypothesis (usually a null hypothesis of no effect).

11 votes

Now that I've rejected the null hypothesis what's next?

Note first that @Nick Stauner makes some very important arguments regarding optional stopping. If you repeatedly test the data as samples come in, stopping once a test is significant, you're all but g …
jona's user avatar
  • 1,844
4 votes

Hypothesis testing for a correlation that is zero or negative

Strange that no direct answer to the original question has been given (even though @Nick Stauner and @Glen_b nicely elaborated on possibly superior alternatives). The wikipedia article discusses vario …
jona's user avatar
  • 1,844
0 votes

Why aren't multiple hypothesis corrections applied to all experiments since the dawn of time?

Is it possible to control the false discovery rate without applying some such correction? Yes. This is what a threshold on p values does: it sets the rate of false discoveries to that threshold. …
jona's user avatar
  • 1,844
5 votes
Accepted

Avoiding p-values and reporting t-values instead. References?

A reference can be found in footnote 1 of Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Langua …
jona's user avatar
  • 1,844
0 votes

What does p-value mean in R?

The p-value tells you the probability of the under the null hypothesis. The null hypothesis can be a wide range of things, but using your example, in the first case, it is: sample 1 and sample 2 repr …
jona's user avatar
  • 1,844
0 votes
Accepted

T-Testing, test if one average exceeds another at the 5% level

First, consider what kind of t-test you want to use. There is the unpaired two-t-test, comparing two unmatched, independent samples; the two-sample paired t-test, comparing two matching samples (such …
jona's user avatar
  • 1,844
2 votes

How do I know a simple validation result is statistically significant when comparing machine...

You're using two different meanings of significance here. how do we know the difference in term of accuracy is significant enough? Here you're talking about practical impact, or effect size. Wha …
jona's user avatar
  • 1,844
3 votes
Accepted

Designing Frequentist A/B Experiments

There are two questions here: What should one establish before an experiment? What is the relationship between $\alpha$, $\beta$, effect size and study size? The two are separate, because you can …
jona's user avatar
  • 1,844