Search Results
Search type | Search syntax |
---|---|
Tags | [tag] |
Exact | "words here" |
Author |
user:1234 user:me (yours) |
Score |
score:3 (3+) score:0 (none) |
Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
Views | views:250 |
Code | code:"if (foo != bar)" |
Sections |
title:apples body:"apples oranges" |
URL | url:"*.example.com" |
Saves | in:saves |
Status |
closed:yes duplicate:no migrated:no wiki:no |
Types |
is:question is:answer |
Exclude |
-[tag] -apples |
For more details on advanced search visit our help page |
Hypothesis testing assesses whether data are inconsistent with a given hypothesis (usually a null hypothesis of no effect).
11
votes
Now that I've rejected the null hypothesis what's next?
Note first that @Nick Stauner makes some very important arguments regarding optional stopping. If you repeatedly test the data as samples come in, stopping once a test is significant, you're all but g …
4
votes
Hypothesis testing for a correlation that is zero or negative
Strange that no direct answer to the original question has been given (even though @Nick Stauner and @Glen_b nicely elaborated on possibly superior alternatives). The wikipedia article discusses vario …
0
votes
Why aren't multiple hypothesis corrections applied to all experiments since the dawn of time?
Is it possible to control the false discovery rate without applying some such correction?
Yes. This is what a threshold on p values does: it sets the rate of false discoveries to that threshold. …
5
votes
Accepted
Avoiding p-values and reporting t-values instead. References?
A reference can be found in footnote 1 of Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Langua …
0
votes
What does p-value mean in R?
The p-value tells you the probability of the under the null hypothesis. The null hypothesis can be a wide range of things, but using your example, in the first case, it is: sample 1 and sample 2 repr …
0
votes
Accepted
T-Testing, test if one average exceeds another at the 5% level
First, consider what kind of t-test you want to use. There is the unpaired two-t-test, comparing two unmatched, independent samples; the two-sample paired t-test, comparing two matching samples (such …
2
votes
How do I know a simple validation result is statistically significant when comparing machine...
You're using two different meanings of significance here.
how do we know the difference in term of accuracy is significant enough?
Here you're talking about practical impact, or effect size. Wha …
3
votes
Accepted
Designing Frequentist A/B Experiments
There are two questions here:
What should one establish before an experiment?
What is the relationship between $\alpha$, $\beta$, effect size and study size?
The two are separate, because you can …