Timeline for Do I have a multiple comparisons scenario here?
Current License: CC BY-SA 4.0
10 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jan 5, 2022 at 21:21 | comment | added | BruceET | How can you know what I certainly did or didn't do? We simply have different opinions about the importance of adjustments in significance levels in ad hoc tests to avoid 'false discovery`. I don't think your view predominates, but you have a right to it, nevertheless. One of many virtues of this site is mainly-cordial disagreements. | |
| Jan 5, 2022 at 21:10 | comment | added | Michael Lew | It seems that you did not really read my answer, and that you certainly did not read the linked chapter. There are many circumstances where error rate (family-wise or not) is not of interest to the inferences that should be drawn. You are therefore incorrect in assuming that global error rates should always be protected by 'corrections' or 'adjustments' for multiplicity. | |
| Jan 4, 2022 at 20:43 | comment | added | BruceET | If you are doing ad hoc tests to compare $k$ levels of a factor significant at the 5% level, then the ad hoc tests have to be judged according to a more rigorous standard then the main effect. At the 5% level you expect one false rejection in 20, If $k=7$ then there are potentially ${7 \choose 2}=21$ pairs to compare, so even if most are the same, there is a risk of 'false discovery' testing at the 5% level. Bonferroni is only one method of adjusting the P-values. Because it's based on an inequality, it is a bit too conservative. | |
| Jan 4, 2022 at 20:11 | comment | added | Michael Lew | The 'adjustment' is what, for example, the Bonferroni does. | |
| Jan 4, 2022 at 20:06 | comment | added | BruceET | @MichaelLew: Don't understand your question. What "adjustment"? | |
| Jan 4, 2022 at 19:55 | comment | added | Michael Lew | Do you have any comment on the discrepancy between your answer which assumes that an adjustment of some sort is necessary and mine in which I say that there are many circumstances in which such an adjustment is undesirable? | |
| Jan 4, 2022 at 17:03 | history | edited | BruceET | CC BY-SA 4.0 |
added 23 characters in body
|
| Jan 4, 2022 at 8:31 | history | edited | BruceET | CC BY-SA 4.0 |
added 33 characters in body
|
| Jan 4, 2022 at 8:24 | history | edited | BruceET | CC BY-SA 4.0 |
added 33 characters in body
|
| Jan 4, 2022 at 8:12 | history | answered | BruceET | CC BY-SA 4.0 |