Linked Questions
11 questions linked to/from When combining p-values, why not just averaging?
3
votes
0
answers
177
views
Methods for meta-analysis: z-transform (Stouffer's approach) vs. Fisher's method vs.... infinite others? [duplicate]
Fisher's method and Stouffer's approach (z-transform) for meta-analysis roughly follow the same scheme:
take the p-values from some different experiments on the same hypotheses
apply to them some ...
- 271
24
votes
4
answers
11k
views
Stouffer's Z-score method: what if we sum $z^2$ instead of $z$?
I am performing $N$ independent statistical tests with the same null hypothesis, and would like to combine the results into one $p$-value. It seems that there are two "accepted" methods: Fisher's ...
- 107k
14
votes
3
answers
16k
views
R package for combining p-values using Fisher's or Stouffer's method
Is there an R package (or even a base R function) that implements Fisher's or Stouffer's method for combining p-values? Coding this should be almost trivial, but I'd rather use (and cite) a package.
...
- 789
7
votes
1
answer
3k
views
Is it valid to take a mean of p-values during cross-validation, when comparing the predicted output of a model to the actual output? [closed]
I am doing a cross-validation study, training a model on an input to predict a target.
During training, my model generates an output vector that is guaranteed to be the same size as the corresponding ...
- 79
2
votes
1
answer
1k
views
Bonferroni-type corrections and Fisher Method Meta-analysis
I'm not an expert on the field, but I need to know more about how to combined multiple significance test p-values after a two sample Kolmogorov Smirnov (KS)test on two distributions.
But I have two ...
- 23
4
votes
4
answers
171
views
Why do we work with factor of likelihoods instead of e.g. a sum for a batch in the negative log likelihood loss function?
In a classification task, at a certain stage of the training process, we get a likelihood of sampling proper class Y for a particular data point X. For batch, we get many independent likelihoods.
Let'...
2
votes
1
answer
565
views
Difference between Fisher's method and the sum of chi-square test statistics
I'm learning about combining $p$-values and I have a couple of (somewhat elementary, perhaps) questions. Suppose I have $n$ independent tests, each of these to test its own null hypothesis $H_0 (i)$, $...
- 317
1
vote
1
answer
627
views
Testing multiple comparisons of paired proportions
I want to know if a proportion increased significantly after an event, and then find out if that holds true over multiple events. I'm using a paired t-test to measure this with continuous data (e.g. ...
- 11
1
vote
1
answer
527
views
Use p-values to weight correlations before combining them
I have a correlation between two dimensions $A$ and $B$, each dimension has 1 variable $i$ with $j$ samples. $A_i$ and $B_i$ (Let's call it $r_{Di}$). I also have a correlation of $A_i$ with another ...
- 595
2
votes
1
answer
147
views
p-Value of mean of sample means
I suspect this question is related to:
When combining p-values, why not just averaging?
Let me explain my problem:
Suppose you have a set of sample means and associated p-values, standard errors ...
- 123
1
vote
0
answers
51
views
Test for change in all observerd variables
Let us say, I observe 3 variables in a control condition and a treatment condition. I would like to find out whether the treatment has some effect on all 3 variables at the same time. I should mention ...
- 173