I have a panel data crosscountry regression with following structure ($y$ as a drug addiction rate of the country, $x$ as number of homeless of the country and $m$ as HIV infection rate of the country) and I categorize my countries in four world regions which I code as Dummys $D_1$, $D_2$, $D_3$ and the fourth region as reference category:

$y = b_1x + b_2m + b_3D_1m + b_4D_2m + b_5D_3m$ (1)

When I change my base category every coefficient and significance value except $b_1$ changes.

When I change my regression to:

$y = b_1x + b_3D_1m + b_4D_2m + b_5D_3m + b_6D_4m$ (2)

the coefficients in (2) are the same as $b_2$ in regression (1) with the same significance values depending on the reference category

Now I don't understand what I am seeing. the maineffect coefficient $b_2$ is the effect of the reference category and not the mean of the HIV infection rate effect? What does my main effect coefficient $b_2$ say? In regression (1) why does my significance values $b_3$, $b_4$, and $b_5$ change if I change my reference category and what does the significance of $b_3$, $b_4$, and $b_5$ mean regarding my main effect $b_2$? I am completely confused right now.

Best regards, Rub_n

  • $\begingroup$ How are you modelling the error terms? What kind of model is this? Ordinary least squares? Logistic regression? $\endgroup$ – StatsStudent Dec 20 '18 at 23:33
  • $\begingroup$ Do you really have crosscountry data or is this supposed to be cross-sectional? $\endgroup$ – StatsStudent Dec 20 '18 at 23:34
  • $\begingroup$ I use an OLS regression with group and time fixed effects. Yes I have crosscountry data. $\endgroup$ – Rub_n Dec 21 '18 at 0:10

Consider a model with only 3 regions and hence two dummies $D_1$ and $D_2$. Assume the data is crosscountry so $i=1,...,n$ are countries. Let the model equation be

$$y_{it} = b_1 x_{it} + b_2 m_{it} + b_3 D_1 m_{it} + b_4 D_2 m_{it} + \epsilon_{it}$$

implying that the conditional expected rate of drug addiction is

$$\mathbb E[y \lvert data] = b_1 x_{it} + b_2 m_{it} + b_3 D_1 m_{it} + b_4 D_2 m_{it}$$

hence the model allows for different regions to have different marginal effects of HIV infection rate $m$ on drug addiction rate $y$ - so their drug addiction rate responds differently to change HIV infection rate compared to the reference region.

For the reference region $D_1=D_2=0$ the conditional effect reduces to

$$\mathbb E[y \lvert data] = b_1 x_{it} + b_2 m_{it}$$

differentiating with respect to $m_{it}$ to get

$$\frac{\partial \mathbb E[y \lvert data]}{\partial m_{it}} = b_2$$

which is the marginal effect of HIV infection rate $m$ on drug addiction rate $y$ for contries in the reference region. An increase of one unit in HIV infection rate in a country $i$ from the reference region result in a change of $b_2$ units in the drug addiction rate of country $i$.

For countries from the region defined by $D_1=1$ and $D_2=0$ the conditional expectation is

$$\mathbb E[y \lvert data] = b_1 x_{it} + b_2 m_{it} + b_3m_{it} $$

and the marginal effect

$$\frac{\partial \mathbb E[y \lvert data]}{\partial m_{it}} = b_2 + b_3$$

hence $b_3$ is the difference in the marginal effect of HIV infection rate $m$ on drug addiction rate $y$ for contries in region $D_1=1$ compared to the reference region, for which the marginal effect was simply $b_2$. Hence if $b_3$ is positive then it appears that countries from region $D_1=1$ reacts stronger changes in the HIV infection rate with respect to the drug addiction rate.

So $b_2$ measures the increase in drug addiction rate as a result of a 1 unit increase in the HIV infection rate $m$ for the countries in the reference region. An the values of $b_3$ changes when you change the reference because it is the difference the marginal effect between some region - here $D_1=1$ and the reference - and offcourse the difference depend on what the region is compared to. The significance of $b_3$ means that you can reject the null hypothesis that countries from region $D_1=1$ have the same marginal effect as countries from the reference region.

In the second model there is no reference category so now the coefficients $b_3,b_4,b_5$ and $b_6$ are region specific marginal effects (not differences in the marginal effect). The purpose of this model is that it will allow you to test for the significant marginal effect of HIV infection rate on drug addiction rate for each region simply by testing the significance of the coefficients. To test for differences between regions in this model you have to test differences in coefficients for example $H0: b_3 = b_4$, which can easily be performed as a Wald test for example. However in model (1) this comparison between regions in the responsiveness of drug addcition rate to HIV infection rate was performed simply by testing the significance of a coefficient.

  • $\begingroup$ Oh man, that really helps! So the significance of b2 is the significance of the effect of region 3 on my drug addiction rate? $\endgroup$ – Rub_n Dec 21 '18 at 0:19
  • 1
    $\begingroup$ b_2 measure the effect on drug addiction rate of a 1 unit increase in the HIV infection rate for countries belonging to the reference region. It's significance means it is significantly different from 0 therefore you can reject the null hypothesis that HIV infection rate do not affect drug addiction rate in countries from this region (I dont know what you define as region 3??) $\endgroup$ – Jesper Hybel Dec 21 '18 at 0:25
  • $\begingroup$ perfect thank you so much, so do i have a benefit of using regression (2) instead of doing four different regressions for each region except having a bigger sample size for the effect of x? $\endgroup$ – Rub_n Dec 21 '18 at 0:31
  • 1
    $\begingroup$ See edit of my repsonse last two paragraphs. $\endgroup$ – Jesper Hybel Dec 21 '18 at 0:46
  • 1
    $\begingroup$ pls. accept and upvote if you think the answer was helpful :) $\endgroup$ – Jesper Hybel Dec 21 '18 at 0:54

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.