Skip to main content
9 votes

How to permute p-values?

There is no statistical method that will allow you to "ensure" that significant results are not false positives. However, there are well-established scientific methods. Those methods involve ...
Michael Lew's user avatar
  • 17.2k
5 votes
Accepted

Stouffer's Method: Restriction on underlying hypothesis tests producing p values?

Stouffer's method does not assume that the p-values were obtained from z-tests / z-scores. It just makes use of the fact that if the null hypothesis is true for a particular test, then $p \sim \textrm{...
Wolfgang's user avatar
  • 17.9k
3 votes

How to permute p-values?

A use of permutations in controlling family wise error rate is described in Romano, Joseph P., and Michael Wolf. "Exact and approximate stepdown methods for multiple hypothesis testing." ...
Sextus Empiricus's user avatar
3 votes

How to permute p-values?

Your core question is: "This brings up a question: how can we ensure these 30 results are not generated by random events?" I should point out that both the t.test and p.adjust already do ...
George Box's user avatar
1 vote

How to permute p-values?

Few thoughts: This brings up a question: how can we ensure these 30 results are not generated by random events? Unless you already know which hypothesis is true (the null or alternative), no ...
jarbet's user avatar
  • 409

Only top scored, non community-wiki answers of a minimum length are eligible