Questions tagged [bonferroni]

Bonferroni refers to a method of adjustment for multiple comparisons in which the p value is divided by the number of tests. It is more conservative than many other such methods.

Filter by
Sorted by
Tagged with
10
votes
1answer
689 views

p-value adjustment for Local Moran's I statistic (LISA)

I'm working with some exploratory spatial analysis in R using spdep package. I came across an option to adjust p-values of local indicators of spatial association (LISA) calculated using ...
8
votes
2answers
4k views

How to apply multiple testing correction for gene list overlap using R

I have 2 studies looking at the patient response to the same drug. Study 1 found 10,000 genes expressed above the background and 500 of them are differentially expressed and referred to as the drug ...
2
votes
1answer
466 views

How can I perform a familywise error rate correction for Johansen cointegration tests?

I want to test multiple possible cointegration relationships with the Johansen cointegration test. I'm currently using the urca package in R with the ca.jo test. I was going to use the Bonferroni ...
3
votes
2answers
53k views

Bonferroni adjustment in SPSS - what does it do?

I'm probably being a bit simplistic here, but from what I understand the Bonferroni post hoc test is simply when we adjust the alpha to account for inflated error when several post hoc tests are ...
3
votes
1answer
166 views

Question regarding Bonferroni correction

Prove the following version of the Bonferroni inequality- $$P\left(\bigcap_{i=1}^kA_i\right)\ge1-\sum_{i=1}^kP(A_i^c)$$ When creating simultaneous confidence interval, what are $A_i$ and $A_i^c$? ...
1
vote
1answer
10k views

Two questions about Bonferroni adjustment

I have two questions about Bonferroni adjustments: 1). Can one use the Bonferroni method to compare independent groups? The reason why I ask this is it seems that many examples I've encountered ...
1
vote
1answer
877 views

Determining number of tests to correct for using Bonferroni

I am doing final revisions to my dissertation, which includes a large number of regressions. I have six outcome variables (DVs) and I am testing the effect of four primary (correlated) IVs, but I am ...
2
votes
0answers
73 views

Is this a valid method to control the FWER?

I have a huge number, say $M$, of hypotheses that are potentially correlated. I have a dataset $D$ of random samples from an unknown distribution and I want to do test the hypotheses for significance ...
3
votes
1answer
4k views

Anova repeated measures is significant, but all the multiple comparisons with Bonferroni correction are not?

I counducted a mixed model ANOVA with time as the within subjects variable (3 levels) and group as the between subjects variable (2 levels). All is significant (time, group, and timeXgroup). To test ...
8
votes
3answers
24k views

Post hoc test in a 2x3 mixed design ANOVA using SPSS?

I have two groups of 10 participants who were assessed three times during an experiment. To test for differences between groups and across the three assessments, I ran a 2x3 mixed design ANOVA with <...
1
vote
0answers
3k views

Non parameteric tests for 2*2 mixed design

I have 2*2 mixed design, where the two factors are time and group. The time levels are pre- and post-intervention, and the group levels are control and intervention. If I were using a parameteric ...
1
vote
1answer
515 views

Strict Bonferroni - looking for p value

I run 18 exploratory regressions and would like to know what the strict Bonferroni p-value would be. Nine regressions are negative binomial regressions with 4 predictor variables, the other 9 are WLS ...
2
votes
2answers
324 views

Best way to go about correcting for multiple comparisons (or should one even) for a small dataset?

Disclaimer: I have a very minimal stats background and am just getting into this stuff. Corrections to any terminology I use or an improved rephrasing would be super appreciated. I have a simple ...
2
votes
0answers
2k views

Bonferroni correction in generalised linear model

I am running a generalised linear model in R. I have a single response variable and a maximum of 4 possible explanatory variables. I am adding each explanatory variable to the model sequentially, ...
1
vote
1answer
3k views

Permutation tests in R for correlations

What's the easiest way to run permutation tests for a bivariate Pearson correlation matrix in R? I have tried running MPT.Corr, Multivariate Permutation Test for Correlations by Urbano Blackford et ...
5
votes
2answers
9k views

Bonferroni and Greenhouse-Geisser corrections with repeated-measures ANOVA

I guess my question comes in two parts: Following a 1x7 repeated-measures ANOVA, I carried out 3 pre-planned tests. Two were t-tests between 2 of the conditions. The third is a 1x6 ANOVA (to test ...
2
votes
0answers
889 views

Multiple comparisons process using Kruskal-Wallis, G-Test and corrections

I want to know if changing a button color has a positive effect on different measures (see the 4 measures below), using the following process: There's a default button, which is the fixed control ...
13
votes
4answers
43k views

Sidak or Bonferroni?

I am using a generalized linear model in SPSS to look at the differences in average number of caterpillars (non-normal, using Tweedie distribution) on 16 different species of plants. I want to run ...
1
vote
0answers
2k views

Fisher's exact test and large tables with pairwise

I found that it is possible to look at adjusted residuals and treat them as a z-score and then use a two-tailed test to find a p-value. The problem is how do you calculate adjusted residuals on what I ...
5
votes
1answer
1k views

Sample-size calculations for Benjamini-Hochberg, Westfall-Young, Holm-Bonferroni methods

I'm currently setting up an experiment where we might want to do multiple comparisons (i.e. comparing several treatments with a control at the same time). It is pretty straightforward to calculate the ...
4
votes
1answer
256 views

What is the basis for adjusting critical values in multiple t-tests?

Let's say I have three samples: control, A, and B. (I am assuming basic things about sampling like no bias, no confounding factors, and independence in selecting samples.) I want to see if there is a ...
0
votes
1answer
1k views

What type of error correction do I have to use after Wilcoxon matched pairs test?

Do I have to use Bonferroni's or Holm's corrections? Please see this previous question for my example data and the design. (Shortly, I have three or more dependent groups.)
5
votes
2answers
3k views

Repeated measures ANOVA in R and Bonferroni adjusted intervals

If somebody can tell me what R commands I need to use for a repeated measures ANOVA, I'd really appreciate it. I have trouble with the random term. I've seen ...
19
votes
4answers
84k views

Maximum number of independent variables that can be entered into a multiple regression equation

What is the limit to the number of independent variables one may enter in a multiple regression equation? I have 10 predictors that I would like to examine in terms of their relative contribution to ...
19
votes
1answer
84k views

Bonferroni or Tukey? When does the number of comparisons become large?

Reading Field's Discovering Statistics Using SPSS (3rd Edition) I was struck by a bit about post-hoc tests in ANOVA. For those wanting to control the Type I error rate he suggests Bonferroni or Tukey ...

1 2 3 4 5 6