Bonferroni refers to a method of adjustment for multiple comparisons in which the p value is divided by the number of tests. It is more conservative than many other such methods.

learn more… | top users | synonyms

1
vote
0answers
31 views

Hypothesis testing with finite interval as null hypothesis

There exist two-tailed tests ($H_0: \mu = c$) and one-tailed tests ($H_0: \mu \leq c$ and $H_0: \mu \geq c$). I am interested in the case of the null hypothesis being an interval, that is $H^{ab}_0: ...
0
votes
0answers
23 views

Finding the Significant Differences (with p-values) in a 4x2 Chi-Square Table Using SPSS

In short, I would like to learn how to discover where the significant differences lie within a 4x2 Chi-Square table and report the significant findings with a p-value, preferably using SPSS. Setup: ...
4
votes
0answers
61 views

Cherry picking and low p-values

Let's say I run a lot of univariate OLS regression models, say 200,000, with 50 data points, then cherry pick the best one (highest r-square). If my $p$-value for this model is way less than ...
0
votes
0answers
12 views

Post-Hoc Chi-Sq test - conclusions drawn from comparing individual categories

My question is very similar to this one: (Post hoc $\chi^2$ test with R), but I'm still confused, and tried to provide as much detail as possible. I have two categories of students: Domestic and ...
0
votes
1answer
23 views

Fisher's exact test and Bonferroni correction

I compared Survivability (live or die) using tibial Intraosseous (io), humerus io, tibial io, intravenous epinephrine for patients who have cardiac arrest. We had a control group that received no ...
1
vote
1answer
13 views

criteria for choosing a post-hoc tests

After eg. ANOVA there are several post-hoc tests out there (e.g. Tukey, Bonferroni, etc.) but what are the criteria for choosing one over the other? If one is more conservative, shouldn't we use it ...
0
votes
2answers
61 views

Multiple testing adjustment in linear models

I have troubles with multiple testing correction (For example, bonferroni adjustment. I'm aware that it's not most correct one). ...
1
vote
1answer
31 views

Dependence, independence, multiple testing, and alpha error correction

although I have studied psychology and feel I should know a lot more about issues such as this one, I have a quite basic question (or maybe not so basic question, considering all the fuss about this) ...
0
votes
0answers
38 views

Bonferroni post hoc test in R for repeated measure ANOVA with mixed within and between subjects design

I need to perform a Bonferroni post hoc test in R on a table with three within subjects factors (Emotion, having 5 levels, Material, having 4 levels, Shoes, having 2 levels) and one between subject ...
0
votes
0answers
24 views

Bonferroni correction for multiple testing and overlapping groups

I have allele frequency observations from a large geographic region that can be logically subdivided into smaller areas in a number of different and meaningful ways. If I were to test these ...
1
vote
1answer
66 views

Repeated Measures ANOVA and the Bonferroni post hoc test different results of significantly

I am doing an Repeated Measures ANOVA and the Bonferroni post hoc test for my data using R project. The ANOVA gives a significantly difference between the data but not the Bonferroni post hoc test. ...
0
votes
0answers
24 views

What to do after a significant Exact test?

I have significant Fisher exact tests for a 2x3 and 6x3 contingency table. All I can get from it is that the observation regarding columns and rows are not random. But I don't know which combination ...
2
votes
1answer
29 views

Does the bonferonni correction change the outcome of the p-value or is it just changin what you accept as significant?

For some reason I can't seem to integrate the bonferonni corrected p adjustment into my multiple comparisons t test in r so I need to do each of my 3 tests individually. What I wondered was do I need ...
2
votes
0answers
49 views

Bonferroni Adjustment and Assumptions?

I'd just like to get clarification on something. When you perform a bonferroni adjustment (dividing the alpha level by the amount of tests you want to do, if say you're doing multiple ANOVAs) do you ...
0
votes
0answers
39 views

Bonferroni correction of bootstrap generated p values

I have run a multiple regression analysis with 900 independent variables and bootstrapped this analysis 1000 times, with replacement, to generate bootstrap p values. When I looked at the results, I ...
1
vote
1answer
31 views

Do I need to use a Bonferroni adjustment?

I am using three different ANOVAs to determine significance across two treatment levels. Because we only have two species I chose to run the same set of analyses for each of the species instead of ...
2
votes
1answer
101 views

Bonferroni Correction p value in SPSS [duplicate]

I have run an analysis on data using SPSS. I have a repeated measures design with 7 conditions. I chose to do pairwise comparisons to see where the effects lie and used the Bonferroni correction. If ...
1
vote
0answers
37 views

Bonferroni Corrections for multiple control groups

We recently ran a marketing test at work where we are looking at the amount of customers that make a transaction at the store if we do not email them, Email them, email them AND send them a physical ...
3
votes
0answers
61 views

Is there a consensus on adjusting alpha for multiple contrasts if the main effect is significant?

After talking to a couple of statisticians, reading some book sections, internet articles, and forums like this, I am still unclear about multiplicity adjustments of post hoc tests and contrasts. ...
0
votes
0answers
42 views

Standard multiple regression and multiple dependent variables. and bonferroni correction?

I have a question regarding running multiple regression equations with multiple dependent variables. Three independent variables and 3 dependent variables. A colleague advised me to conduct three ...
6
votes
1answer
135 views

Confidence intervals from the Holm-Bonferroni test?

I'm a newcomer in the problem of multiple comparisons. I wonder how to calculate confidence intervals for Holm-Bonferroni method? I know that for Bonferroni method we can just change the confidence ...
1
vote
0answers
40 views

Bonferroni adjustment according to which families?

We have 17 subjects in a crossover design of three groups: Challenge agent (CA) CA+ compound of interest (CI) CI - Our data proves this has no physiological effect, and is thus not used in ...
1
vote
1answer
56 views

Bonferroni method for multiple comparisons with 1-way layout

My statistics book describes the Bonferroni method of doing multiple comparisons with a one-way layout as essentially performing a t-test with each pair of interest with a significance level scaled ...
0
votes
0answers
27 views

Post-hoc test on 3 groups comparison

I have 3 groups each with 6 values. After performing acceptable levene test for Homogeneity of Variance, I performed Anova on my data. It was significant, and I started to perform post-hoc test. The ...
0
votes
0answers
85 views

Significant Friedman's test vs. non-significant multiple comparisons

I am currently running a randomized, placebo-controlled, cross-over design for a new type of intervention. This intervention is compared to a placebo and another more conventional type of treatment. ...
0
votes
0answers
41 views

Multiple t-tests and Bonferroni

I have two independent groups (healthy weight and overweight) and want to compare three different variables between the two groups (BP, cholesterol, body fat). I know I need to run three separate ...
0
votes
0answers
115 views

Fisher's exact test for 3x5 contingency table in R with post-hoc? Consistently with using Fisher or Chi-squared?

I'm struggling with some (relatively simple) stats questions for some work I'm doing in R, and can't seem to find answers online... I have a factorial response variable of habitat type of a species ...
0
votes
0answers
27 views

Which means difference test to use?

Currently, my data is count data and I am analyzing it in Proc Glimmix in SAS. My data focuses on how many times birds from two treatments performed stand, sit, forage, ect.... So it basically looks ...
0
votes
2answers
90 views

Multiple test correction for categorical variables with many levels

I am creating a binary logistic regression model with the inputs as a single categorical variable with 100 levels. My goal is to find which level of the categorical variable is most likely to result ...
1
vote
1answer
582 views

Bonferroni correction on multiple Kruskal-Wallis tests

My data consists of 3 groups, and 6 variables. The data are not normal so I want to use non-parametric tests to uncover significance. The first thing I wanted to get your opinion on is, is it ...
0
votes
0answers
24 views

Bonferroni family of confidence intervals for fitted values from loess method

I did loess nonparametric regression using one predictor and I wanted to build confidence band around my fitted values. I saw the some posts(links below) for this topic and found that an approximation ...
3
votes
0answers
258 views

Report in ANCOVA: descriptive means or estimated marginal means?

I have conducted an analysis of covariance, ANCOVA, followed by Bonferroni post-hoc tests, on SPSS. I want to report the differences between my groups in text (APA style) and in a corresponding bar ...
2
votes
0answers
71 views

How is plot of p-values distribution related to calculation of the false discovery rate?

I'm running t-tests for all combinations of pairwise comparisons of average length of stay for patients among 30 hospitals. My first approach was to use a Bonferroni corrected significance level of ...
3
votes
1answer
155 views

p-value correction for multiple t-tests?

My dataset consists of $n$ genes, each of them described by a vector of expression values, $5$ for "healthy" individuals, and $5$ for "unhealthy" individuals. I am going to run $n$ t-tests (one for ...
0
votes
1answer
95 views

multiple pair wise nonparametric comparisons

is it possible to perform multiple pair wise nonparametric comparisons (generally using a Mann–Whitney test) and adjust the significance level used for the decision criteria using a Bonferroni-type ...
0
votes
0answers
222 views

Post-hoc with Bonferroni a correction after ANOVA with repeated measure in SPSS

does somebody know where I can find the t value of post-hoc tests with Bonferroni correction when using SPSS.From what I get so far, I only see p values. Should I add a command in the script? Thank ...
0
votes
0answers
35 views

Statistical test for Comparing 6 classifiers over 5 datasets

I did the Friedman test to compare 6 classifiers which are tested over 5 datasets. The null hypothesis was rejected so I proceed with the post-hoc Bonferroni. The X classifier is always first on all ...
3
votes
0answers
339 views

How to best approach ANOVA with multiple response variables that might be correlated and Bonferroni Correction

I need some help verifying a simple analysis. I have completed a simple two factor experiment of more or less equal sample sizes. Let's assume for the case of this question that the sample sizes are ...
2
votes
0answers
11 views

Appropriate correction for tests for determining best of family

I have a sample of $N$ instances of a problem (assumed to be independent samples of an infinite population of instances). To each of these instances I apply $M$ methods, and record how quickly they ...
3
votes
5answers
332 views

What's wrong with Bonferroni adjustments

I had read an article has this title "What's wrong with Bonferroni adjustments?" for Thomas V Perneger He summarized saying that Bonferroni adjustment have, at best, limited applications in ...
0
votes
2answers
48 views

Is Bonferroni Correction Appropriate for this Analysis?

Suppose I have performed a study wherein I compare a novel intervention (N) against the standard intervention (S). Participants are assigned to N or S randomly, and the study is performed. There are ...
3
votes
1answer
33 views

Do I need to do p-value correction after Kendall correlations?

I'm a neuroscientist and I've done some statistics before, but I'm fairly new to corrections of the p-value (like Bonferroni). I've got 2 groups of patients. For each group, I look into 3 areas of ...
2
votes
1answer
131 views

How to describe three groups where the means of two groups are significantly different, but neither of the two groups differ from a third group?

I am comparing 3 means from normal distributions using student's test: $\mu{_1}, \mu{_2}, \mu{_3}$ Results are: $\mu{_1} = \mu{_2}, \mu{_2} = \mu{_3}, \mu{_1} \ne \mu{_3} $ If I want to group my ...
5
votes
2answers
136 views

Extent of multiple testing correction

A bit of a strange question. In my fourth year biostatistics class today, we were discussing when and when not to use multiple testing correction, and the professor made an offhand comment. He asked ...
0
votes
0answers
27 views

Follow up comparisons for a repeated measures ANOVA while ignoring some factors

So I have a big data frame with my dependent variable stored in RT and my subject number stored in s. I'm interested in doing within-subject ANOVAs on the means of each subject score per unique ...
0
votes
1answer
174 views

Appropriate non-parametric post-hoc test for baseline comparisons?

I want to evaluate several "classifiers" (machine-learning algorithms) with paired samples. I do not want to compare each algorithms' performance to every other (n x m comparison) but only compare the ...
3
votes
4answers
786 views

About the Bonferroni correction

I have 50 variables in my dataset. I have correlated each variable against each variable, thus I have $49·50/2 = 1225$ unique correlations when no variable is tested against itself. Now, suppose I ...
0
votes
0answers
38 views

Multiple comparisons, multidimensional data, several groups

Could you please help me with such a problem: Let's assume I have multidimensional data that consists of 30 samples and 10 variables. This is a 30x10 matrix. I have three groups of equal size (10 ...
4
votes
1answer
193 views

Why is the Bonferroni correction properly used with planned, and not post hoc, contrasts?

The Wikipedia article on Post hoc analysis says "Bonferroni correction (This is properly used with planned, not post hoc, contrasts.)" but does not explain why the Bonferroni correction is properly ...
4
votes
1answer
71 views

What is the intuition for dependence assumption in Benjamini and Hochberg (1995)?

For dealing with multiple testing, Benjamini and Hochberg (1995) assume that the tests are independent. Benjamini and Yekutieli (2001) show that (1) the 1995 result also holds under (I think) weaker ...