Skip to main content
Cross Validated

Return to Answer

edited body
Source Link
Huy Pham
Huy Pham
  • 1.2k
  • 13
  • 17

So the log likelihood ratio test showed that your second model is a better fit than your first model. You should interpret that one.

Firstly, is d or a categorical or continuous? If either of them are categorical then you should plot your results as they really help you to understand your results. Suppose that both of them are, our interaction term a:d is significant so you should expect the mean of your dependent variable z to be different at different levels of a to not be parallel across d, they may even intersect e.g like this. If they are both continuous, it's hard to plot them, but it's still the same interpretation.

With regards to your hypothesis, if the effect of a:d is significant it means that the effect of a on z depends on the levels/size of d. You'll see below it's in the direction you hypothesized. When there's an interaction term its effect 'eats up' all the effect of the main effects a and d so that's why they can end up being non significant sometimes. Often, people are told not to interpret the main effects anymore if the interaction is significant. The main effect is still included in the model because the interaction's effect is nested within the main effect. You still need the main effect to, for example, predict values of the dependent variable (see below). But for hypothesis testing purposes it often no longer makes sense to interpret the main effect on its own anymore. Because there is no 'single' main effect of a if the interaction is significant. As your hypothesis shows, if the effect of a on z decreases as d increasesdecreases, so there's no way to talk about a on its own without talking about d also. Again, there isn't a single/unified effect of a, but an changing effect, depending on d.

Now, for balance, there is a counterpoint to this common perception here, where they say sometimes it's ok to interpret a even if the interaction term is significant. But all they're saying is that sometimes/occasionally even if the main effect of a changes across the level of d you can still conclude a is always a positive effect. But I think that's largely quibbling, because a still has a different effect across d even if it's always a positive effect. The coefficient of a still doesn't make sense on its own.

Finally, in your case. Let's have a look at your final model equation (i'm going to assume that they're continuous now, because it just makes it easier to explain, but if they are categorical then just look at this website for more info): $$\frac{p}{1-p}=e^{-2.30656-0.10448a+2.05082b+2.66973c-0.04204d+0.31179a*d}$$

So, now control for b and c and the intercept by substituting in values of 0 for them.

$$\frac{p}{1-p}=e^{-0.10448a-0.04204d+0.31179a*d}$$

For when a is 1 but d is large, let's say 5 $$\frac{p}{1-p}=e^{-0.10448*1-0.04204*5+0.31179*1*5}=3.4704$$ which means the odds of z has increased by 247%. Now, for a 1 unit increase in a and when d is now small, let's say 1, sub in those numbers $$\frac{p}{1-p}=e^{-0.10448*1-0.04204*1+0.31179*1*1}=1.1797$$ which means the odds of z has increased by only 17%. So, your second hypothesis is true, for smaller values of d the effect of a has decreased.

So the log likelihood ratio test showed that your second model is a better fit than your first model. You should interpret that one.

Firstly, is d or a categorical or continuous? If either of them are categorical then you should plot your results as they really help you to understand your results. Suppose that both of them are, our interaction term a:d is significant so you should expect the mean of your dependent variable z to be different at different levels of a to not be parallel across d, they may even intersect e.g like this. If they are both continuous, it's hard to plot them, but it's still the same interpretation.

With regards to your hypothesis, if the effect of a:d is significant it means that the effect of a on z depends on the levels/size of d. You'll see below it's in the direction you hypothesized. When there's an interaction term its effect 'eats up' all the effect of the main effects a and d so that's why they can end up being non significant sometimes. Often, people are told not to interpret the main effects anymore if the interaction is significant. The main effect is still included in the model because the interaction's effect is nested within the main effect. You still need the main effect to, for example, predict values of the dependent variable (see below). But for hypothesis testing purposes it often no longer makes sense to interpret the main effect on its own anymore. Because there is no 'single' main effect of a if the interaction is significant. As your hypothesis shows, if the effect of a on z decreases as d increases, so there's no way to talk about a on its own without talking about d also. Again, there isn't a single/unified effect of a, but an changing effect, depending on d.

Now, for balance, there is a counterpoint to this common perception here, where they say sometimes it's ok to interpret a even if the interaction term is significant. But all they're saying is that sometimes/occasionally even if the main effect of a changes across the level of d you can still conclude a is always a positive effect. But I think that's largely quibbling, because a still has a different effect across d even if it's always a positive effect. The coefficient of a still doesn't make sense on its own.

Finally, in your case. Let's have a look at your final model equation (i'm going to assume that they're continuous now, because it just makes it easier to explain, but if they are categorical then just look at this website for more info): $$\frac{p}{1-p}=e^{-2.30656-0.10448a+2.05082b+2.66973c-0.04204d+0.31179a*d}$$

So, now control for b and c and the intercept by substituting in values of 0 for them.

$$\frac{p}{1-p}=e^{-0.10448a-0.04204d+0.31179a*d}$$

For when a is 1 but d is large, let's say 5 $$\frac{p}{1-p}=e^{-0.10448*1-0.04204*5+0.31179*1*5}=3.4704$$ which means the odds of z has increased by 247%. Now, for a 1 unit increase in a and when d is now small, let's say 1, sub in those numbers $$\frac{p}{1-p}=e^{-0.10448*1-0.04204*1+0.31179*1*1}=1.1797$$ which means the odds of z has increased by only 17%. So, your second hypothesis is true, for smaller values of d the effect of a has decreased.

So the log likelihood ratio test showed that your second model is a better fit than your first model. You should interpret that one.

Firstly, is d or a categorical or continuous? If either of them are categorical then you should plot your results as they really help you to understand your results. Suppose that both of them are, our interaction term a:d is significant so you should expect the mean of your dependent variable z to be different at different levels of a to not be parallel across d, they may even intersect e.g like this. If they are both continuous, it's hard to plot them, but it's still the same interpretation.

With regards to your hypothesis, if the effect of a:d is significant it means that the effect of a on z depends on the levels/size of d. You'll see below it's in the direction you hypothesized. When there's an interaction term its effect 'eats up' all the effect of the main effects a and d so that's why they can end up being non significant sometimes. Often, people are told not to interpret the main effects anymore if the interaction is significant. The main effect is still included in the model because the interaction's effect is nested within the main effect. You still need the main effect to, for example, predict values of the dependent variable (see below). But for hypothesis testing purposes it often no longer makes sense to interpret the main effect on its own anymore. Because there is no 'single' main effect of a if the interaction is significant. As your hypothesis shows, if the effect of a on z decreases as d decreases, so there's no way to talk about a on its own without talking about d also. Again, there isn't a single/unified effect of a, but an changing effect, depending on d.

Now, for balance, there is a counterpoint to this common perception here, where they say sometimes it's ok to interpret a even if the interaction term is significant. But all they're saying is that sometimes/occasionally even if the main effect of a changes across the level of d you can still conclude a is always a positive effect. But I think that's largely quibbling, because a still has a different effect across d even if it's always a positive effect. The coefficient of a still doesn't make sense on its own.

Finally, in your case. Let's have a look at your final model equation (i'm going to assume that they're continuous now, because it just makes it easier to explain, but if they are categorical then just look at this website for more info): $$\frac{p}{1-p}=e^{-2.30656-0.10448a+2.05082b+2.66973c-0.04204d+0.31179a*d}$$

So, now control for b and c and the intercept by substituting in values of 0 for them.

$$\frac{p}{1-p}=e^{-0.10448a-0.04204d+0.31179a*d}$$

For when a is 1 but d is large, let's say 5 $$\frac{p}{1-p}=e^{-0.10448*1-0.04204*5+0.31179*1*5}=3.4704$$ which means the odds of z has increased by 247%. Now, for a 1 unit increase in a and when d is now small, let's say 1, sub in those numbers $$\frac{p}{1-p}=e^{-0.10448*1-0.04204*1+0.31179*1*1}=1.1797$$ which means the odds of z has increased by only 17%. So, your second hypothesis is true, for smaller values of d the effect of a has decreased.

Source Link
Huy Pham
Huy Pham
  • 1.2k
  • 13
  • 17

So the log likelihood ratio test showed that your second model is a better fit than your first model. You should interpret that one.

Firstly, is d or a categorical or continuous? If either of them are categorical then you should plot your results as they really help you to understand your results. Suppose that both of them are, our interaction term a:d is significant so you should expect the mean of your dependent variable z to be different at different levels of a to not be parallel across d, they may even intersect e.g like this. If they are both continuous, it's hard to plot them, but it's still the same interpretation.

With regards to your hypothesis, if the effect of a:d is significant it means that the effect of a on z depends on the levels/size of d. You'll see below it's in the direction you hypothesized. When there's an interaction term its effect 'eats up' all the effect of the main effects a and d so that's why they can end up being non significant sometimes. Often, people are told not to interpret the main effects anymore if the interaction is significant. The main effect is still included in the model because the interaction's effect is nested within the main effect. You still need the main effect to, for example, predict values of the dependent variable (see below). But for hypothesis testing purposes it often no longer makes sense to interpret the main effect on its own anymore. Because there is no 'single' main effect of a if the interaction is significant. As your hypothesis shows, if the effect of a on z decreases as d increases, so there's no way to talk about a on its own without talking about d also. Again, there isn't a single/unified effect of a, but an changing effect, depending on d.

Now, for balance, there is a counterpoint to this common perception here, where they say sometimes it's ok to interpret a even if the interaction term is significant. But all they're saying is that sometimes/occasionally even if the main effect of a changes across the level of d you can still conclude a is always a positive effect. But I think that's largely quibbling, because a still has a different effect across d even if it's always a positive effect. The coefficient of a still doesn't make sense on its own.

Finally, in your case. Let's have a look at your final model equation (i'm going to assume that they're continuous now, because it just makes it easier to explain, but if they are categorical then just look at this website for more info): $$\frac{p}{1-p}=e^{-2.30656-0.10448a+2.05082b+2.66973c-0.04204d+0.31179a*d}$$

So, now control for b and c and the intercept by substituting in values of 0 for them.

$$\frac{p}{1-p}=e^{-0.10448a-0.04204d+0.31179a*d}$$

For when a is 1 but d is large, let's say 5 $$\frac{p}{1-p}=e^{-0.10448*1-0.04204*5+0.31179*1*5}=3.4704$$ which means the odds of z has increased by 247%. Now, for a 1 unit increase in a and when d is now small, let's say 1, sub in those numbers $$\frac{p}{1-p}=e^{-0.10448*1-0.04204*1+0.31179*1*1}=1.1797$$ which means the odds of z has increased by only 17%. So, your second hypothesis is true, for smaller values of d the effect of a has decreased.