# Statistical test for injury data

I have patient mental and physical health scores and looking for differences pre and post injury. The injuries are categorical by anatomic site and severity. I was told to run a GEE with Walds test and everything came back significant, which doesn't make sense to me. Why should an ankle injury be as significant as a spinal injury? Since this data is collected every few years, I doubt a twisted ankle would leave significant decreased mental health scores after a few years. Something is not right.

Doing some research, I'm finding a ANCOVA or repeated measures ANOVA to be appropriate. However, when I run those tests I'm not seeing which classes are significant, just overall significance of the injury site / severity.

Can someone guide me to which is the appropriate test and if I'm using SAS, how to see significance by class?

Information about the data: injury group = 21,400 no injury group = 5900 dependent variables are continuous Quality of Life score(can be pre and post or can calculate change in pre/post, either way continuous) predictor variables are categorical (can be 2 variables, anatomic site + severity, or combined as 1 variable), also have some covariates anatomic site is 8 levels (1-8) severity is 5 levels (A-E) so they can be combined as 1A, 1B, ... 8E

Most important information is which anatomic site / severity class level are significant and which are not.

I ran Cohens d and got little to moderate effect size. I got higher effect sizes by stratifying by anatomic site + severity (1A, 1B, ... 8E) but still highest is 0.4.

• Regardless of whether you expect a certain result or not, we cannot tell without the data whether there's anything wrong. You collect data to learn something, so results shouldn't be dismissed solely on the basis that they differ from what you expect. In fact, re-analysing data because you don't like the results invalidates testing. (It will obviously lead to a final result that confirms your expectations with a too high probability.) Feb 17, 2022 at 9:57
• Note also that significance doesn't tell you anything about effect sizes, and injury A being "as significant" as injury B does not mean that the effects of the two injuries are the same. For such comparisons, you better interpret the effect sizes. Feb 17, 2022 at 9:58
• Following up on the comments by @ChristianHennig please provide more information about the nature of your data and the results you have obtained. With a large enough study almost everything can appear "significant" statistically; the question is whether the differences are "significant" practically. That's why you will see emphasis here on "effect sizes" rather than "statistical significance." Please provide that information by editing the question, as comments are easy to overlook and can be deleted.
– EdM
Feb 17, 2022 at 15:47
• I added more information. Is there anything else I can tell you? Although tests shouldn't be dismissed on the basis that they are not what we expect, I still get suspicious when everything comes back significant. It's a red flag. Feb 18, 2022 at 5:37
• Your sample sizes are quite large, and this means that even small effect sizes can come out significant. Feb 20, 2022 at 13:40