Skip to main content

All Questions

Tagged with
Filter by
Sorted by
Tagged with
0 votes
0 answers
24 views

Multivariate (two-way/two-factor) ANOVA post hoc tests proper significance calculation method

I would like to get a proper justification for choosing one of the three of the various methods used to determine the causes of interactions in post-hoc procedures for multivariate ANOVA. I have ...
kwadratens's user avatar
0 votes
0 answers
53 views

Does the Holm-Bonferroni procedure really correct for FWER in the context of ANOVA?

I wanted to make sure that post-hoc tests with the Holm-Bonferroni procedure behave nominally on typical ANOVA data under the null hypothesis. To do so, I computed the p-values and FWER obtained from ...
larmor's user avatar
  • 123
1 vote
0 answers
66 views

Why is an alpha adjustment not required for factorial ANOVA?

When conducting a 2-way fixed effects ANOVA, there are essentially four null hypothesis statistical tests (NHSTs) that can reasonably conducted with just the ANOVA tables. The first is the omnibus ...
Gregg H's user avatar
  • 6,064
1 vote
1 answer
325 views

How to get the group differences after Bonferroni correction in multiple comparison?

After an ANOVA in R, do you know if it is possible to get the group differences using Bonferroni correction ? If I use the iris dataset ...
Xav64's user avatar
  • 169
0 votes
0 answers
46 views

ANOVA: which test is to be chosen when they differ in significance?

I am using the software PAST*. When running an ANOVA I have available these tests: Tuckey's pairwise, Kruskal-Wallis, Mann-Whitney pairwise and Dunn's post hoc. I am trying to see if three species are ...
dandelion's user avatar
3 votes
3 answers
301 views

One-way ANOVA for multiple features?

I have 60 continuous features (i.e., lab results) for 35,000 patients, and the patients are divided into three groups. I want to evaluate each feature to find out what the differences are between the ...
Mon's user avatar
  • 31
1 vote
1 answer
220 views

Bonferroni (or BH) correction for multiple t-test?

I'm studying the kinematics differences between males and females examined at two different specific walking speeds (slow/fast). Specifically, I'm exploring: a) slow speed vs high speed (dependent t-...
Fede R's user avatar
  • 23
0 votes
0 answers
183 views

Kruskal Wallis test or ANOVA for G-mean?

I currently working on the data (4 groups), which requires the evaluation in Geometric means. I transform the data into logarithms (which is non-normal distributed), then I wonder whether to use ANOVA ...
Skyrise058's user avatar
0 votes
0 answers
61 views

Anova or Bonferroni correction needed?

I've read a bit when it is appropriate to use Anova/Bonferroni correction over multiple t-tests but I am not sure if it applies to my data. I am extracting audio features from themed Spotify playlists ...
beld's user avatar
  • 63
0 votes
2 answers
97 views

ANOVA post-hoc correction question

I am currently analysing data from a recent experiment, in which I will perform a 2 way repeated measures ANOVA (exercise intensity [3 intensities] x time [5 time points]). I have a significant ...
Lightwelter's user avatar
1 vote
0 answers
76 views

Need to run Bonferroni correction if only doing 1 paired-samples t-test?

Say I have a significant interaction for a 2x3 within-subjects ANOVA. If I have a theoretical justification for only running a single paired samples t-test to look at simple main effects (even when ...
jelly1's user avatar
  • 23
1 vote
0 answers
134 views

Am I (reviewer) correct or is the researcher correct re: Bonferroni?

I've been asked to review an article for a low-tier journal, such that I am the only reviewer with stats knowledge (such as it is; I used to teach stats and advanced stats, but it's been a few years ...
JasperRabbit's user avatar
1 vote
1 answer
656 views

Shouldn't the adjusted p value be less than the normal p value?

I am following an SPSS tutorial for Kruskall-wallis test. In the example give, we are comparing the driving reaction time for 3 groups (each group contain 10 subjects) following a drink. 1st grp was ...
Ahmad Dabboussi's user avatar
0 votes
0 answers
26 views

Calculating alpha level for Bonferroni

I have 4 null hypotheses. I want to conduct 4 two-way mixed ANOVAs (one between-subjects factor and one within-subjects factor) for each of my 4 dependent variables. I will use the same between-...
CC25's user avatar
  • 33
2 votes
1 answer
21 views

Difficulties in choosing a correct test for the analysis of variance e then a multi comparison test

I have these groups : ...
Spartan 117's user avatar
1 vote
0 answers
665 views

Comparing different samples from different years: ANOVA?

I have been collecting data for 10 consecutive years. Once in each year different participants (N=110/Year) had to rate the importance of each one of 30 different social values, on a Likert scale (1-5)...
Nikola's user avatar
  • 21
1 vote
0 answers
108 views

Multiple testing between treatment groups, and between subgroups within treatments. Bonferroni correction required?

I have a data set that is structured such that I have four treatment groups with 6 samples each; 3 samples in each treatment were taken at an early time point, and the other three were taken at a ...
Roxanne's user avatar
  • 13
2 votes
1 answer
428 views

Is there any consensus on adjusting p-values for multiple tests?

I'm confused as to when adjustments for multiple tests need to be used. I'm an undergrad who's familiarising himself with stats, so apologies if my question sounds dumb, but I haven't found any ...
danjeff's user avatar
  • 21
0 votes
1 answer
1k views

Bonferroni Adjustment to Multipe Comparisons AND Multiple ANOVA's

I'm running four one-way ANOVAs using a different DV each time. Each ANOVA has one DV and four IV condition levels. I currently have each ANOVA set up in a different data file. I would have liked to ...
statshelpneeded's user avatar
0 votes
2 answers
424 views

Bonferroni correction in one-way ANOVA for one dependent variable

I have a quick question I hope somebody could help me with; If I have two one-way ANOVA's in my research just comparing the means of three age groups for a single dependent variable (so two seperate ...
CalcBoy's user avatar
  • 25
0 votes
1 answer
211 views

A one-way ANOVA for multiple comparison

Cheng, H., & Liu, S. (2019). Haptic Force Guided Sound Synthesis in Multisensory Virtual Reality (VR) Simulation for Rigid-Fluid Interaction. In 2019 IEEE Conference on Virtual Reality and 3D User ...
sysexits's user avatar
0 votes
2 answers
166 views

Multiple comparison adjustment with multiple outcomes, measured over time

I am trying to work out the most appropriate way to adjust for multiple comparisons. I have 20 biomarkers which have been measured at 4 timepoints (baseline & three unevenly spaced follow-ups). I ...
Bryony Simmons's user avatar
0 votes
1 answer
2k views

Significant main effect but no interaction which post hoc test to do?

I have an experiment looking at the effect of rearing condition on development of the number of neural networks (ensembles) in mice. I therefore have two factors (Age 3, 5, 7 dpf) and Rearing ...
neurosoup's user avatar
4 votes
1 answer
77 views

Considering pre-tests in family-wise error correction doing an ANOVA

When I do multiple tests on a dataset, I need to correct for the family-wise error (e.g. using Bonferroni method when performing multiple pairwise t-tests). If I do an ANOVA, I need to make sure that ...
Xafer's user avatar
  • 41
1 vote
0 answers
155 views

3 way ANOVA / Duncan test

I am runnig 3 way ANOVA between: specie * organ * treatment in Sucrose acumulation. There is interaction between organ*treatment, but no interaction between specie and organ or treatment. Should I ...
Andres Echeverria's user avatar
2 votes
1 answer
3k views

Is it necessary to do a Bonferroni correction on a) exploratory analysis b) correlations or c) if there are 3 different dependent variables

My study is a 2x2 within design and I have a series of 8 hypotheses. These include one ANOVA , one t-test and 4 Pearson correlations. However, the ANOVA and 3 of the correlations include the same ...
Holly Miller's user avatar
1 vote
1 answer
2k views

Pairwise comparisons after ANOVA with Tukey and Bonferroni methods in r

The built-in functions TukeyHSD and LSD.test from R perform pairwise comparisons. In order to maintain the type I error, the significance level $0.05$ is divided by the number of comparisons $k$. Do ...
user228804's user avatar
1 vote
0 answers
266 views

FIsher's LSD test is appropriate for restricted mean comparisons

Suppose that we perform two way ANOVA with interactions, with factors $A$ and $B$ with three level each $A_{1},A_{2},A_{3}$ and $B_{1},B_{2},B_{3}$. We know that Fisher's LSD test is used for ...
G1I2A's user avatar
  • 85
1 vote
0 answers
169 views

How and when to use multiple comparison tests

There seems to be some variability in WHEN multiple comparison tests such as Bonferroni or FDR might be implemented. Type 1: One might carry out multiple one-way ANOVA's to see whether or not there ...
ksroogl's user avatar
  • 423
0 votes
1 answer
147 views

Correcting for multiple tests over time

I am measuring degradation of RNA over time with a control and a treatment. I have % RNA remaining (relative to time 0 for control and treatment) and 5 time points. I would like to test if the % ...
Jake's user avatar
  • 1
1 vote
1 answer
3k views

Correcting for multiple comparisons after multiple ANOVAs

I've had to run 5 different ANOVAs (identical 4-way mixed design ANOVAs including the same factors, but on a different dependent variable [a gait parameter] each time). In this case, what would be the ...
eread's user avatar
  • 11
2 votes
2 answers
2k views

Bonferroni correction in planned contrasts

I have 1 continuous DV and 1 categorical IV with 4 levels. I set up orthogonal dummy coding for 3 planned contrasts. I then used the linear model to observe if the planned contrasts are significant. ...
Sarah's user avatar
  • 59
1 vote
0 answers
81 views

Does a Split File Datasat need a correction for multiple comparison?

I searched already for similiar problems but couldn't find an answer. I split the file in SPSS by a two-level between group variable (sequence) and then want to perform two ANOVAS on each of those ...
Ralf Pierson's user avatar
1 vote
0 answers
185 views

Should I use t-test or ANOVA+post hoc (two different treatments and a control)

I have been working with ice algaes,and Im looking on their fattyacids. Here is a bit about the experimental design. I have one treatment area, cleared, where I have removed all snow. I have ...
Nicole S.'s user avatar
1 vote
1 answer
1k views

post hoc tests in ANOVA

While I am doing post hoc test for one way ANOVA, I am getting significant results for LSD but the same variables does not have significant values for Bonferroni. Why is it so?
Dishari Gupta's user avatar
4 votes
0 answers
785 views

a priori power analysis for ANOVA plus post hoc test

I would like to perform an a priori power analysis to calculate required sample size for data to be analyzed using one way ANOVA and Tukey HSD post hoc test. (I want to determine pair-wise which ...
jlarsch's user avatar
  • 181
3 votes
2 answers
482 views

Is Bonferroni correction used for multiple levels, multiple factors, or both?

Bonferroni correction can help us correct our alpha values in multiple statistical testing. One aspect that I am confused on: Is Bonferroni correction used when we have multiple levels (Does this ...
user avatar
3 votes
0 answers
106 views

Difference between one-way ANOVA and all pairwise comparisons with Bonferroni correction [duplicate]

If you have five groups and you wish to know if there is a significant difference between any of the group means, you would have to do 10 pairwise comparisons to test all possible pairs of means. You ...
user avatar
0 votes
1 answer
458 views

How come we have Bonferroni correction when we have ANOVA analysis?

ANOVA analysis can be used to determine the significance of multiple groups. Why do we need Bonferroni correction to re-compute the alpha values? ANOVA solves the problem of multiple testing by ...
user avatar
3 votes
1 answer
159 views

Why do I need a Bonferroni correction if we are evaluating our primary outcome?

We have completed a study comparing control with vitamin D supplement and with bone building drug. The primary outcome is change in bone mineral density. My statistician states that because we are ...
madeleine Rooney's user avatar
2 votes
1 answer
6k views

Repeated Measures ANOVA and the Bonferroni post hoc test different results of significantly

I am doing an Repeated Measures ANOVA and the Bonferroni post hoc test for my data using R project. The ANOVA gives a significantly difference between the data but not the Bonferroni post hoc test. <...
Gianni's user avatar
  • 173
1 vote
1 answer
112 views

Do I need to use a Bonferroni adjustment?

I am using three different ANOVAs to determine significance across two treatment levels. Because we only have two species I chose to run the same set of analyses for each of the species instead of ...
amela's user avatar
  • 33
10 votes
3 answers
5k views

Is there a consensus on adjusting alpha for multiple contrasts if the main effect is significant?

After talking to a couple of statisticians, reading some book sections, internet articles, and forums like this, I am still unclear about multiplicity adjustments of post hoc tests and contrasts. Let'...
Sophocles's user avatar
  • 131
5 votes
2 answers
760 views

Bonferroni method for multiple comparisons with 1-way layout

My statistics book describes the Bonferroni method of doing multiple comparisons with a one-way layout as essentially performing a t-test with each pair of interest with a significance level scaled ...
Barry's user avatar
  • 261
4 votes
0 answers
3k views

How to best approach ANOVA with multiple response variables that might be correlated and Bonferroni Correction

I need some help verifying a simple analysis. I have completed a simple two factor experiment of more or less equal sample sizes. Let's assume for the case of this question that the sample sizes are ...
Phillip Mann's user avatar
5 votes
1 answer
1k views

Why is the Bonferroni correction properly used with planned, and not post hoc, contrasts?

The Wikipedia article on Post hoc analysis says "Bonferroni correction (This is properly used with planned, not post hoc, contrasts.)" but does not explain why the Bonferroni correction is properly ...
user1205901 - Слава Україні's user avatar
25 votes
4 answers
44k views

Is Fisher's LSD as bad as they say it is?

When we perform experiments (on small sample sizes (usually the sample size per treatment group is about 7~8)) on two groups, we use a t-test to test for difference. However, when we perform an ANOVA (...
Rover Eye's user avatar
  • 587
3 votes
1 answer
9k views

When should I use FDR or Bonferroni in multiple comparisons?

I have the following situations : (1) Very large number of variables - say 100 variables and 200 samples (observations). Although level of each variable is just 2 or 3 or 4 max. I am doing linear ...
John 's user avatar
  • 2,268
1 vote
2 answers
125 views

What are correlations among between test statistics in multiple comparison procedures

In the book Multiple Comparisons Using R Bretz et al write that their R package multcomp improves power above other multiple comparison procedures by "accounting for the structural correlations ...
N Brouwer's user avatar
  • 2,173
0 votes
1 answer
4k views

Bonferroni-correction after one-way ANOVA

I conducted a one-way ANOVA: I had two groups and tested, if they differ in three different DVs. Since I tested three times, I thought it was wise to go for Bonferroni-correction. But then I got the ...
Jennifer's user avatar