It is known that with large sample sizes, even a small difference could be statistically significant although it may not be practically meaningful. For my current analysis, the difference in the proportions of drug adherence between two cohorts was only 1%. A simple test would show that it was statistically insignificant. However, after throwing other covariates into a logistic regression, the estimate for the cohort variable appeared to be marginally significant with p-value 0.03.
I am just seeking advice on how I should report on such a result? My thoughts are that:
Just report on the naive result from the chi-square test.
Report on the 3 way tables for cohorts, adherence and a covariate of interest.
Logistic regression on adherence with all covariates of interest for each cohort separately, and graph the odds ratio and CI for two cohort side by side.
Report on the actual result from logistic regression with cohort variable, and put some explanations on why the result is not meaningful.