I am working with a dataset where the dependent variable is $y$ (level of use of a line of credit) and the key independent variables are $x_1$ and $x_2$ (two different types of interest rates).

Some lines of credit have both types of rates and, hence, $x_1$ and $x_2$ have values. Other lines of credit have just one of the rates (say, e.g., the first one) and $x_1$ has a value whereas the value in $x_2$ is missing. In addition, interest rates may occasionally be $0$.

Therefore, I have two problems:

  1. If I regress y on $x_1$ and $x_2$, I lose those observations where, e.g., $x_1$ has value but $x_2$ has a missing value, although it is missing, not because I do not know the value, but because the line of credit does not include the second interest rate. Does anyone know a sound way of solving this problem? I have thought of replacing missing values with $0$. Would this be correct? Does it matter the fact that interest rates themselves can be $0$?

  2. The second problem arises because I also use interaction terms of the form, e.g., $x_1d$, where $d$ is a dummy variable that is either $0$ or $1$. Since $x_1$ can be $0$, the interaction term can be $0$ not because $d = 0$, but because $x1 = 0$. Can anyone help me to solve this? I have thought of adding a small value (say, $0,001$) to $x_1$ and $x_2$. Does this affect the results?

  • $\begingroup$ Is it theoretically possible that there could have been an interest rate but didn't happen to be one, or is it not possible for there to have been one in those cases? $\endgroup$ Commented Jan 31, 2015 at 18:51
  • $\begingroup$ The first option (i.e., there could have one but there is not). Think, for instance, of applying for a loan. You may be charged a monthly interest rate and an upfront fee, but someone else may be charged with those fees and a cancellation fee. $\endgroup$
    – madu
    Commented Jan 31, 2015 at 19:19
  • $\begingroup$ So the observations aren't quite missing, then? Ie, it isn't that there was such a rate, but it wasn't recorded for some reason, but rather there was no rate in the first place (& this is conceptually different from a rate of 0). Is that right? $\endgroup$ Commented Jan 31, 2015 at 20:33
  • 1
    $\begingroup$ I added the [econometric] tag because this strikes me as partly a question of economic / econometric theory, as well as just statistical practice. We have such experts here. It will be interesting to see what they have to say. $\endgroup$ Commented Jan 31, 2015 at 20:40
  • $\begingroup$ You are right, Gung. It is not a problem of not recording: the line of credit does not have the rate, and I know that it does not have it (I have collected data manually). And not having a rate is different from the rate being 0 (the rate can be 0 because, for instance, you just have to pay if you use the line of credit above a given threshold). PD: Thanks for adding the tag [econometric]. $\endgroup$
    – madu
    Commented Jan 31, 2015 at 20:55

2 Answers 2

  1. You use regression, if you know the shape of the model (e.g. linear, quadratic,...) but want to analyze the coefficients of certain variables in the model. Consequently, you can build a model where all credit lines with their various interest rates are mapped to some indicator of time preference and/or risk or whatever, depending on your research objective. Then you'll do your regression with this indicator, that can be derived for all credit lines. Of course, this is only as good as your model, but this applys to all regression models as well.

  2. Interaction terms of the factors $a$ and $b$ are written as $(ab)$, but they are not really products. The notation $(ab)$ only tells you that $a$ and $b$ are involved. The interaction term is not the product of the main effect terms.

EDIT: You have to consider the principles of linear models. We have $$Y=Xb+\epsilon.$$ $Y$ is the response, $b$ is the vector of regression coefficients or effects to be estimated. $X$ contains the independent variable's outcomes or dummy variables, respectively. These dummy variables have the value 0 or 1 just in order to "select" certain rows in $b$ that would be used for estimating. So if there is a 1 in column $k$ of $X$, entry $k$ in vector $b$ will be considered as relevant parameter for estimation and modelling. One thinks that the value of this parameter --if relevant-- just adds to the response variable.

From this point of view, an interaction can just be seen as completely different factor that has conincidentially $a_1\cdot a_2$ levels, if there are already $a_1$ and $a_2$ levels of two main effects. $X$ just gets $a_1 \cdot a_2$ more colums and $b$ respectively more parameters. So you really don't have to worry about some main effect being 0. In fact, you could merge main effects and interactions to a single overall effect with $a_1 \cdot a_2$ levels. This would create a nonsingular model, where the design matrix $X$ has now full column rank.

Concerning 1), I don't believe you should approach your research question with a linear model since investment decisions are hardly linear in the interest rates. I would suggest to build first a model about the preferences of the credit schemes, but that's just my personal opinion because I've been taught in my economics studies that understanding and modeling economic decisions is fundamental to modeling econometric data. Then you would perhaps get some ideas on how to deal with the nonlinearity and possibly instrumental variables. But I don't have enough insight into your research question, of course.

  • $\begingroup$ Regarding 1), if I get you right, are you suggesting me to use instrumental variables? As regards 2), and to be sure that I understand you correctly, suppose that x1 is a type of interest rate that can be 0 or positive and d is 1 (0) if it is a fixed (variable) rate. I have four possible situations: (i) fixed, positive rate, (ii) variable, positive rate, (iii) fixed, 0 rate, (iv) variable, 0 rate. However, x1·d is equal to 0 in the last three situations. What you mean is that this is irrelevant if I am trying to analyze the effect of having a fixed rate over the dependent variable? $\endgroup$
    – madu
    Commented Feb 1, 2015 at 14:35

Please consider the following as a personal view (not an expert advice).

Probably issue 2 is not a problem at all, practically speaking.

For the problem 1 I would use multiple imputation (MI). Basically, (1) it creates, let's say, 10 datasets. In each data set numbers for missing values are slightly different. (2) you run your regression ten times. (3) you obtain one summary result for your regressions.

In Stata and in SAS there is a straightforward implementation of MI. For data which you have described, Stata code could be:

 mi set mlong
 mi register imputed  x2 
 mi impute regress x2 y x1, add(10) rseed(65154)
 /*may or may not include d above, not sure */ 
 mi estimate: reg y x1 x2

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.