4
$\begingroup$

Background:

I have been asked to model the change of weight of a few animals undergoing experimentation via a simple GLM (General Linear Model). The data looks something like this. Note that all data are normally distributed.

Data

I did try to log transform the data t smooth out the line, but that was not working. The following was on non transformed data.

In short, it is a timecourse experiments with weight being monitored weekly for 11 weeks under treatment of a drug or placebo.

Model:

So here is the model that I constructed. Week + Strain + Treatment + WeekStrain + WeekTreatment + StrainTreatment + WeekStrain*Treatment

It looks like it was a good guess, and a we can see from the table below, we can safely remove all interaction terms as they are not affecting the model in any way(do correct me if I am wrong, as I am not a student of statistics.

ModelFit

Anyway, now to further explain the differences, I performed a posthoc (bonferroni). TO give these results

Posthoc

All well and good, and the results are as expected.

Question

Now for my question, as we can see in the posthoc, say for example the strain FvB Saline vs FvB treated has a mean difference of -2.83g. Great! Except I do not know where does this difference lie. Is it the difference obtained by averaging all values of mass in the strain and subtracting from each other ?

That is

$$x = \frac{\sum FvBTreated_{(weeks_{1-11})}}{n} - \frac{\sum FvBSaline_{(weeks_{1-11})}}{n'}$$

Which makes sense,as when I perform that computation, as it gives the same value. Or is anything else being calculated behind the scene?

Apologies for being so thick, but if my above assumption is right, why did I perform the GLM in the first place ? I could have just started with the averaging and did a multiple t-test

And secondly, I will not be able to use the post hoc data, as the averaging of the entire series of data is wrong, as it does not make sense scientifically. The drug administered has a greater effect (measured by weight gain) in the initial weeks, with diminishing returns each following week, hence an average across all weeks can not be applied.

So, is there any other way to quantify the data (so I can write up on a paper), that I can use? If you need the raw data let me know, and I can send it over.

EDIT:

THIS EDIT IS OFF-TOPIC TO THE MAIN QUESTION. I included it nonetheless, just as a reference as to how I proceeded forward in relation to the glm

I have been pointed out that the model to be used here is a repeated measures on the weeks variable.

Applying the repeated measures variable had caused quite a bit of shuffling around the data in the way its organised. Since I kept running out of degrees of freedom when I asked the model (nicely) to figure out if an interaction existed between Strain and treatment, I had to take into account of that.

Essentially, instead of having 2 separate factors of strain and treatment, I merged them into 1 factor (called CumuStrain here). Since they were nominal variables anyway, it does not matter much.

So In the old GLM model a Strain(factor) of FvB which was treated with Saline(factor), has a new amalgamated factor in CumuStrain defined as "FvB Saline".This is allright in terms of the question being asked (its a bit complex to explain, but we can go ahead and amalgamate it.)

The amalgamated CumuStrain factor also takes care of the problem of the degrees of freedom. After a greenhouse gressier correction, the Weeks*CumuStrain is found to be interacting, with a nice comfy p value of 0.01.

Here is the spss output on scribd https://www.scribd.com/doc/248376572/Log-Dump-SPSS1.

$\endgroup$
6
  • 2
    $\begingroup$ "we can safely remove all interaction terms" note that you did not have sufficient degress of freedom to test 2 of the interaction terms. More importantly, this is a repeated-measures design, so Week cannot be a free term in the model, the model is incorrect. Look into rmANOVA for example. $\endgroup$
    – katya
    Nov 26, 2014 at 20:46
  • $\begingroup$ Oh dear, thanks for pointing it out. I'll correct the model soon. However, do let me know about the post hoc thing ? or does it not apply anymore as the model changes ? $\endgroup$
    – Rover Eye
    Nov 26, 2014 at 20:54
  • $\begingroup$ will have to come back to the post-hoc thing:) - this one is not meaningful. Effect slices week*strain (? - not clear which one is strain which is trt from you graph) is one possibility. $\endgroup$
    – katya
    Nov 26, 2014 at 21:02
  • $\begingroup$ I updated my original post quite a bit with the new model. Weeks*Cumustrain (see original post does indeed interact). Thanks for the heads up. Can you please elaborate on your previous statement as I am not too sure what you mean ? (am a biologist). $\endgroup$
    – Rover Eye
    Nov 26, 2014 at 21:59
  • $\begingroup$ It isn't clear from your edited post (not off-topic for your primary question, btw) whether rm was done correctly. Forgetting this for a moment, the post-hoc does not remain the same if you have an interaction (also obvious from the graph). Here's more info on effect slices ats.ucla.edu/stat/sas/library/SASSlice_os.htm $\endgroup$
    – katya
    Nov 26, 2014 at 22:40

1 Answer 1

1
$\begingroup$

Let's try this again. You independently arrived at the (correct) conclusion that the result of your test is unusable, which is admirable. One of the reasons why it is unusable is that your model treats all data points as independent, whereas they are repeated measures of weight gain, so each measure is a function of the previous. So the problem is not post-hocs per se, it is post-hocs following an incorrect model.

There are many post-hoc tests; they are mostly applied to accomodate more complex designs and adjust for repeated testing. What is needed here is post-hoc comparisons across all treatments by week, and it is necessary to include an interaction term because of the significant interaction. What effect slices will show is that e.g. FvBtreated is significantly different from the other treatments in weeks 3 and 6 (a hypothetical example).

Finally, "the drug has a greater effect in the initial weeks, with diminishing returns each following week" slightly reformulates the question. To address that, it would be more appropirate to express your response variable as the rate of weight gain. This could also be violating the sphericity assumption of rmANOVA eg https://statistics.laerd.com/statistical-guides/repeated-measures-anova-statistical-guide-3.php

$\endgroup$
3
  • $\begingroup$ Ah I see. So essentially, breakdown the posthoc for each level (week) of the repeated measure, in order to have data that can be explained. I will get on that. Though that does make me wonder what will I be reporting if I dont take the effect slices, in effect just ticking the box in SPSS to perform a post hoc with the model (eg. in my log output in my post)? Is that an inappropriate post hoc analysis ? Also thanks for your tip for the rate of change and I will keep an eye out for sphericity violations! $\endgroup$
    – Rover Eye
    Nov 27, 2014 at 20:42
  • $\begingroup$ I can't tell you what the default ticking the box in SPSS is, since I never used it and don't have it installed. It is probably disregarding the confounding week*trt interaction which might matter for the blue and beige trts. But in any case it is less incorrect than the previous one. $\endgroup$
    – katya
    Nov 27, 2014 at 21:24
  • $\begingroup$ AH okay, thanks for your help. SPSS doesnt have a default as such, but I prefer to use bonferroni. Thanks again. $\endgroup$
    – Rover Eye
    Nov 28, 2014 at 1:01

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.