Questions tagged [bonferroni]

Bonferroni refers to a method of adjustment for multiple comparisons in which the p value is divided by the number of tests. It is more conservative than many other such methods.

Filter by
Sorted by
Tagged with
1
vote
1answer
15 views

Can we use the binomial distribution instead of Bonferroni correction for large number of independent significant tests?

Supposing we are doing e.g 1000 one-sample t-tests with the null hypothesis that all population means are 0, with significance level 0.01. One common method for dealing with the number of tests is to ...
1
vote
0answers
23 views

Corrections for multiple hypothesis testing

Apologies if this repeats a previous query, I have read a lot of prior threads (and made myself a bit cross-eyed with the ones asking whether we should correct for every hypothesis test ever performed!...
0
votes
0answers
14 views

Should I use Tukey's test or Bonferroni?

Should I use Tukey's test or Bonferroni as post hoc test for repeated measures ANOVA? I appreciate your reply. /Michael
0
votes
0answers
6 views

Does the Nemenyi test include a correction for multiplicity or do I also have to apply a Bonferroni correction?

Does the Nemenyi test includes a correction for multiplicity or do I also have to apply a Bonferroni correction? I appreciate your answer, /Michael
0
votes
1answer
50 views

Multiple comparison correction for confidence interval

I am trying to understand multiple-comparisons adjustment for confidence intervals. I came across the following links on the topic, but a few things are not clear to me. Stanford lecture: Section 2 ...
0
votes
0answers
10 views

Bonferroni method for adjusted p-values on GEE model

I have longitudinal data from 4 years on 5 stations. For each data point I have dependent data (because the data was collected from the same group of individuals on one day, but I cannot say, if it ...
0
votes
0answers
18 views

chi square multiple testing

I have a survey with more than 3000 respondents on 10 questions. I want to analyse if there is association among certain groups and each of these questions using a chi square test of independence. ...
1
vote
0answers
16 views

Possible multiplicity issues in equivalence testing

I'm currently looking to compare 3 groups, trying to prove equivalence between them. For this, 5 specific parameters are measured for each group, and a pairwise comparison for each parameter among the ...
7
votes
3answers
205 views

Rejection threshold of the Benjamini-Hochberg procedure

Is there a possibility to calculate or estimate the overall rejection threshold of the Benjamini–Hochberg procedure (BH)? For the correction of the FWER using the Bonferroni method, the significance ...
3
votes
3answers
402 views

Why is the p.adjusted() output multipled instead of halved?

I find it kind of hard to grasp the output of the p.adjusted() function in R, when using the bonferroni method. I understand that the Bonferroni correction actually lowers the p-value so that ...
0
votes
0answers
13 views

Adjust alpha in post-hoc-power when bonferroni corrected before?

I was wondering whether I need to adjust my alpha when testing the power of effects for which I have adjusted for multiple testing. This is what I did: Tested the effects of 8 (generalized) linear ...
1
vote
1answer
40 views

Best method to analyse multiple 2x2 contingency tables of a small sample?

I already looked around quite a bit but didn't find answers (I understood), so I apologise if this question should be a duplicate. I'm analysing a small cohort (n=15) of people with some observed ...
1
vote
1answer
24 views

Calculating number of tests in Bonferroni Correction

I understand that applying Bonferroni correction involves dividing alpha by number of tests performed. However, I am unsure about how I can determine the number of tests to divide by. I have 6 IVs ...
1
vote
1answer
221 views

Alternative to Bonferroni Correction when performing multiple one-vs-rest association tests

My question anonymizes the 'nouns' of the question to protect my employer. It is not really about lab rats and experimental treatments. I am also coming more from a Machine Learning background, so my ...
0
votes
0answers
13 views

Best approach to compare multiple two independent portions?

I am running an analysis which I want to know what is the best statistical approach to analyze multiple two independent portions difference to prove that there is no significant different between the ...
1
vote
0answers
12 views

Adjust for multiple comparisons in regression with one outcome variable and several independent variables?

How do I adjust for multiple comparisons using FDR with linear mixed effects first regression: ...
2
votes
0answers
34 views

When to apply Bonferroni correction?

I have 2 conditions, each with 2 factors, making 4 combinations. For each of these 4 combinations, I measure 6 variables. For the sake of illustration, let's say I'm measuring the 'quality' of leaves ...
0
votes
0answers
12 views

Multiple single $2 \times 2$ $\chi$-square tests of independence and Bonferroni correction

I have conducted 6 chi-square tests for independence and all of these tests are $2 \times 2$ tables. Do I need to perform Bonferroni corrections for all these 6 chi-square tests? I appreciate your ...
0
votes
0answers
15 views

Multiple comparison problem: two groups with several parameters

I'm trying to get my head around the multiple comparison problem, read a lot but still in confusion(( I shaped three possibilities, as I see it: I have more than two groups in the research to be ...
1
vote
1answer
42 views

Shouldn't the adjusted p value be less than the normal p value?

I am following an SPSS tutorial for Kruskall-wallis test. In the example give, we are comparing the driving reaction time for 3 groups (each group contain 10 subjects) following a drink. 1st grp was ...
0
votes
1answer
35 views

Testing multiple hypotheses multiple times

I estimate a linear model consisting of one dependent and four independent variables. I want to test wether each of the independent variables has a significant impact on the dependent variable, i.e. I ...
0
votes
0answers
14 views

MANOVA and Hotellings tests

I have a matrix with 33 columns, the matrix can be found here: https://pastebin.com/3pAAGNti Each line of the matrix belongs to a specific group, from 1 to 8. The group number is stored in the last ...
0
votes
1answer
35 views

Running tests over many samples. How to deal with many p-values?

I have 2 sets of 40 000 independent datasets (composed of 10 000 elements each), that I am comparing using an Anderson-Darling test. More precisely, I compare corresponding subsets of my two sets, so ...
1
vote
1answer
104 views

Trouble Understanding Holm-Bonferroni Correction

I have a bit of trouble understanding the Holm-Bonferroni correction. For the normal Bonferroni correction you simply divide your alpha level by the number of tests. For example, if I have 3 tests, I ...
0
votes
0answers
18 views

Calculating alpha level for Bonferroni

I have 4 null hypotheses. I want to conduct 4 two-way mixed ANOVAs (one between-subjects factor and one within-subjects factor) for each of my 4 dependent variables. I will use the same between-...
1
vote
1answer
39 views

How does the Bonferroni correction benefit from independent tests?

In section 2 of this PDF, it is stated that the Bonferroni correction "benefits" from the tests being independent, and that if tests are not independent, the Bonferroni correction could be ...
1
vote
1answer
19 views
0
votes
1answer
29 views

Not understanding adjusted p values with Holm's method. Highest value in series divided by 1

I'm finding an issue while adjusting p-values with Holm's method I cannot understand. It's not a problem in my actual data, but I would appreciate any help to understand the issue. To show the ...
2
votes
1answer
99 views

Correction for multiple testing in Multiple regression analysis

Correction for multiple testing (e.g. Bonferroni correction) is recommended when multiple statistical tests are performed on same data. In multiple regression analysis, multiple testing is integral ...
0
votes
0answers
24 views

How to get the standardized z-statistic from dunn.test-package in R?

Sorry if this is a trivial question, but I couldn't find anything on it. I am running a Dunn-test with the dunn.test-package: ...
0
votes
0answers
6 views

Is a multiple testing correction warranted when you test for specific outcomes?

Suppose we are interested in the association between a binary exposure (0 or 1) and a binary outcome in two subgroups of two cohorts. That is, we have subgroups A-, A+, B- and B+ with $n_{A-} + n_{A+} ...
0
votes
0answers
48 views

Box's M Significant and One variable in Leven's test failed for quality of variance SPSS

I am doing a MANOVA test as part of a psycology project and have to use MANOVA Box's M gives a sign value of less than 0.05 (stated to be used on imb's website) but greater than 0.001 (stated to be ...
1
vote
0answers
49 views

Comparing different samples from different years: ANOVA?

I have been collecting data for 10 consecutive years. Once in each year different participants (N=110/Year) had to rate the importance of each one of 30 different social values, on a Likert scale (1-5)...
1
vote
0answers
22 views

Multiple testing between treatment groups, and between subgroups within treatments. Bonferroni correction required?

I have a data set that is structured such that I have four treatment groups with 6 samples each; 3 samples in each treatment were taken at an early time point, and the other three were taken at a ...
2
votes
1answer
64 views

Is there any consensus on adjusting p-values for multiple tests?

I'm confused as to when adjustments for multiple tests need to be used. I'm an undergrad who's familiarising himself with stats, so apologies if my question sounds dumb, but I haven't found any ...
1
vote
0answers
32 views

Why is the Tukey method not appropriate for covariance analysis when estimating treatment effects?

In the book 'Applied Linear Statistical Models' chapter 22 it states that the Tukey method is not appropriate for covariance analysis. The context is in estimation of treatment effects. Instead, when ...
0
votes
0answers
21 views

Bonferroni correction applied to models of multiple linear regression

I am doing an article in which we assessed the association between the six domains of a scale and clusters of activations. I conducted linear regression analyses between the clusters of activation (5) ...
0
votes
0answers
22 views

Multiple hypothesis and multiple comparison with GLMMs

I have a data set with 20+ variables from the same underlying subjects (animal nests) under three treatments. I have modeled the effect of treatments on each of these variables using seperate GLMMs, ...
1
vote
2answers
53 views

Do I need to use Bonferroni correction?

I have a dataset containing the selling price of mineral stones that were sold in five different countries (namely Germany, France, Italy, Belgium and Spain). I am running multiple t-tests check if ...
1
vote
0answers
7 views

Should multiple adjustedment correction be applied here?

I have a question. I'm analysing an article for an assignement. In this study there are two groups (normal d-dimer vs elevated d-dimer). The study compaires the mean of the groups for multiple ...
1
vote
1answer
55 views

Please can somebody clarify p adjusted values ( via Bonferroni correction method)?

I am using metabolite data generated from LC-MS. I am making comparisons between two groups at a time, and need to account for Type 1 error and multiple comparisons, so I have utilized Bonferroni ...
0
votes
0answers
33 views

How to adjust p-value with Bonferroni correction?

I think this is a simple question, but for which I've found conflicting answers around. Let's say, I measured a biomarker in a group of patients with 5 different methods and I want to perform ...
0
votes
1answer
183 views

Bonferroni Adjustment to Multipe Comparisons AND Multiple ANOVA's

I'm running four one-way ANOVAs using a different DV each time. Each ANOVA has one DV and four IV condition levels. I currently have each ANOVA set up in a different data file. I would have liked to ...
0
votes
0answers
31 views

Multiple metrics on two groups, Bonferroni correction?

I have 8 sets of data before and after a given treatment. Let's call them: a, b, c, d (before), and a', b', c', d' (after treatment). These sets are paired, in the sense that "a" and "a' " represent ...
1
vote
0answers
32 views

Do I have to correct for multiplicity twice if I re-run a comparison with one more hypothesis during incremental testing?

Let's say I have a set of hypotheses ordered in time. These are about comparison to some baseline moment: $H_{t1 vs. baseline}$, $H_{t2 vs. baseline}$, $H_{t3 vs. baseline}$, ... I have 10 time ...
0
votes
0answers
29 views

Incremental hypotheses testing - finding the first occurrence of three consecutive significant effects

I cooperate with a scientist, who measures some effect of a certain procedure over time: t0, t1, t2... Then, the scientist filters out all trivial effects, to avoid reporting statistical significance ...
2
votes
1answer
56 views

Correction p-value with the Bonferroni correction

I have done an analysis using SPSS. I would like to compare the situation before and after treatment in the same patient, so I used the Wilcoxon test (not normally distributed). Now I look at 3 ...
0
votes
2answers
69 views

Bonferroni correction in one-way ANOVA for one dependent variable

I have a quick question I hope somebody could help me with; If I have two one-way ANOVA's in my research just comparing the means of three age groups for a single dependent variable (so two seperate ...
1
vote
1answer
61 views

Statistical testing after adjusted p-values(holm correction)

I have 5 different samples(P1,P2,P3,P4 and P5) with 4 replicates(a,b,c,d).I did paired t-tests with the null hypothesis that there is no significant difference when compared to the control group at p=...
0
votes
0answers
54 views

Do we need the Bonferroni correction when creating confidence intervals from a dynamic linear model?

This is how we would recover the AR1 parameter and the variance of the residuals in an AR1 model using a state space model. ( I saw this code here ) ...

1
2 3 4 5
7