1
$\begingroup$

Suppose we have a linear regression model where the response $Y$ is continuous and have $X_1, X_2$ as continuous predictor variables and $I_1, I_2, I_3, I_4$ as categorical predictors that refer to the seasons, i.e., $I_1$ is fall, $I_2$ is winter, etc.

Suppose we have:

$$ Y = \beta_0 + \beta_1X_1 + \beta_2X_2 + \beta_3I_1 + \beta_4I_2 + \beta_5I_3 + \epsilon $$

where $I_4$ was dropped to prevent multicollinearity.

Normally, the interpretation of $\beta_3$ in a model where there are ONLY categorical predictors is that it is the difference in effects between $I_4$ and $I_1$, and that the intercept is the case where $\beta_0$ is the effect of $I_4$.

However, in this model, how do we interpret $\beta_0$ and $\beta_3$? Do we set the continuous predictors to zero? Thanks.

$\endgroup$
1
$\begingroup$

Effect of Categorical Variable
In the absence of an interaction* with a continuous predictor, the effect of the categorical predictor is the difference with the intercept ($\beta_0$) at any given level of the continuous predictor. After all, if there is no interaction, they are presumed to affect the outcome independently of each other.

So to answer your question directly:

Do we set the continuous predictors to zero?

No, at least not necessarily.

*If there would be an interaction with a continuous predictor, you can only consider the effect of the interaction (i.e. the slope per category), due to the principle of marginality.

Edit
To put it more simple, $\beta_3$ is already the difference between $I_4$ and $I_1$. There is no need to take the continuous predictor into consideration. To whom downvoted this, care to elaborate?

$\endgroup$
  • $\begingroup$ I am not sure that a variable season would be any different from four categories. It would still be treated the exact same way in the regression (i.e. a 4x4 dummy variable matrix with a column dropped due to multicolinearity) $\endgroup$ – JWH2006 Oct 10 '17 at 12:41
  • $\begingroup$ So why then opt to include separate dummy variables? A single factor seems simpler to me. $\endgroup$ – Frans Rodenburg Oct 10 '17 at 14:25
  • $\begingroup$ Depends on the audience? Some reviewers want the model spelled out, some are happy with just having a single variable represent levels. All in all, its mathematically equivalent. $\endgroup$ – JWH2006 Oct 10 '17 at 15:50
  • $\begingroup$ Very well, I'll remove that part $\endgroup$ – Frans Rodenburg Oct 10 '17 at 21:24

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.