9
votes
How to permute p-values?
There is no statistical method that will allow you to "ensure" that significant results are not false positives. However, there are well-established scientific methods. Those methods involve ...
5
votes
Accepted
Stouffer's Method: Restriction on underlying hypothesis tests producing p values?
Stouffer's method does not assume that the p-values were obtained from z-tests / z-scores. It just makes use of the fact that if the null hypothesis is true for a particular test, then $p \sim \textrm{...
3
votes
How to permute p-values?
A use of permutations in controlling family wise error rate is described in
Romano, Joseph P., and Michael Wolf. "Exact and approximate stepdown methods for multiple hypothesis testing." ...
3
votes
How to permute p-values?
Your core question is: "This brings up a question: how can we ensure these 30 results are not generated by random events?"
I should point out that both the t.test and p.adjust already do ...
1
vote
How to permute p-values?
Few thoughts:
This brings up a question: how can we ensure these 30 results are not generated by random events?
Unless you already know which hypothesis is true (the null or alternative), no ...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
hypothesis-testing × 10987statistical-significance × 1928
t-test × 1002
r × 959
p-value × 899
regression × 818
chi-squared-test × 576
self-study × 532
multiple-comparisons × 504
mathematical-statistics × 502
anova × 501
inference × 453
distributions × 444
time-series × 427
confidence-interval × 347
statistical-power × 345
nonparametric × 314
correlation × 301
probability × 292
normal-distribution × 279
binomial-distribution × 277
proportion × 269
bayesian × 250
likelihood-ratio × 230
machine-learning × 222