4
$\begingroup$

I am doing a simple linear regression analysis with 1 independent variable. I am checking data against assumptions. As I am checking against Tolerance and VIF level, I get the their values equal to 1 (both case). Therefore, I guess I shouldn't check against multicollinearity, right?

$\endgroup$

1 Answer 1

9
$\begingroup$

There is not much reason to expect multicollinearity in simple regression indeed. Multicollinearity arises when some regressor can be written as a linear combination of the other regressors. If the only other regressor is the constant term, the only way this can be the case is if $x_i$ has no variation, i.e. $\sum_i(x_i-\bar{x})^2=0$. In that case, $x_i=c$ for all $i$, so that the regressor is just $c$ times the constant, so you get multicollinearity.

Then, the OLSE of the slope parameter is not well-defined: $$ \hat\beta_1=\frac{\sum_i(x_i-\bar{x})(y_i-\bar{y})}{\sum_i(x_i-\bar{x})^2} $$ Such a sample might look as follows: enter image description here Heuristically, it is quite intuitive that OLS breaks down here - $\hat\beta_1$ is supposed to tell you what happens to $y$ if $x$ changes. If your sample does not contain any variation in $x$, it is just not informative about that question.

To give an applied example, suppose you want to investigate the effect of additional labor market experience on earnings but all you observe is employees with exactly 15 years of experience - that sample is not going to tell you anything about the relationship of interest.

Another example might be studying wage discrimination between men and women. If your sample only contains, say, men, you will evidently not learn anything from it about such wage discrimination.

$\endgroup$
2
  • 5
    $\begingroup$ Honestly, I didn't understand anything than the first sentence, but thank you very much, that helped a lot. $\endgroup$ Commented Dec 29, 2015 at 17:25
  • 1
    $\begingroup$ simple version: multicolinearity is when multiple independent variables are too closely correlated with one another. If you only have one independent variable then that whole problem doesn't really come up. $\endgroup$ Commented Jun 27 at 10:48

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.