Timeline for Testing multiple hypotheses multiple times
Current License: CC BY-SA 4.0
4 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Oct 17, 2020 at 8:59 | vote | accept | shenflow | ||
| Aug 10, 2020 at 17:38 | comment | added | EdM | @shenflow each separate hypothesis test needs to be taken into account with respect to multiple comparisons. The advantage of starting with one big model is that you start with a single overall estimate of whether there is any relationship at all between the predictors and the outcome(s). If so, then you can use established ways to handle multiple comparisons within a model that already is known to have some significance. Things like Bonferroni corrections start with the assumption that there might be no significant associations, but a significant overall test makes that already unlikely. | |
| Aug 10, 2020 at 17:26 | comment | added | shenflow | I understand. And what if I do not estimate one model ten times to test a set of hypothesis, but I estimate a set of models 10 times to test a set of hypothesis (e.g. one hypothesis per model). In that case, estimating a single multivariate model does not solve the issue I suppose, or does it? | |
| Aug 10, 2020 at 15:31 | history | answered | EdM | CC BY-SA 4.0 |