# Questions tagged [combining-p-values]

Methods for combining p-values from several hypothesis tests with the same null hypothesis into one aggregate p-value, such as e.g. Fisher's method and Stouffer's method.

61 questions
Filter by
Sorted by
Tagged with
3answers
50 views

2answers
547 views

### How to calculate probability of success based on prior p-value

The FDA often requires a sponsor to conduct multiple clinical trials prior to approval. Given the following observations in a ph2 and ph3 trial, how would you go about predicting the probability of ...
1answer
111 views

### Combine multiple independent permutation tests

I want to find out whether a neural measure measured at 12 time-points is correlated with a behavioral measure measured on the same time-points. I have data from 20 subjects. I'm hoping to perform a ...
1answer
367 views

### Fisher's combined test vs testing uniform distribution of p-values

In testing a global null hypothesis, with independent tests, the p-values are distributed as $U(0,1)$. There are many goodness-of-fit tests to check that the distribution is uniform. For example, this ...
0answers
153 views

### Reference for tail bound of chi square distribution [closed]

Fisher's method allows to combine a set of p values $p_1,\ldots,p_n$. In order to compute the p value associated with Fisher's method one needs to compute the tail of a chi square distribution with ...
1answer
75 views

### Combining different normality transformations for Fisher's method

I have 2 data sets that are applicable to Fisher's method. One has a p-value of 0.07 and the other 0.15. Neither sets were normal or homoscedastic. The first satisfied the ANOVA assumptions only with ...
2answers
699 views

### meta-analysis of p values

I am a bit confused about doing the meta analysis with my data. Given z-scores I calculate p values in a way: p.values = 2*pnorm(-abs(z)). Then I would like to ...
0answers
82 views

1answer
1k views

### MULTIPLE TESTING: Probability of specific outcomes from MULTIPLE experiments using randomized data

This is a follow-up question to this one: Significance test across multiple simulated experiments There's one answer I'm leaning towards accepting, but I wanted to make sure I understood how ...
1answer
405 views

### Significance test across multiple simulated experiments

First time question on this site, so please bear with me, thank you: I have 6 coin-flip-type experiments for which I can calculate 6 binomial p-values. I would now like to calculate the significance ...
4answers
7k views

### Stouffer's Z-score method: what if we sum $z^2$ instead of $z$?

I am performing $N$ independent statistical tests with the same null hypothesis, and would like to combine the results into one $p$-value. It seems that there are two "accepted" methods: Fisher's ...