3
$\begingroup$

I am doing a simple linear regression analysis with 1 independent variable. I am checking data against assumptions. As I am checking against Tolerance and VIF level, I get the their values equal to 1 (both case). Therefore, I guess I shouldn't check against multicollinearity, right?

$\endgroup$

1 Answer 1

7
$\begingroup$

There is not much reason to expect multicollinearity in simple regression indeed. Multicollinearity arises when some regressor can be written as a linear combination of the other regressors. If the only other regressor is the constant term, the only way this can be the case is if $x_i$ has no variation, i.e. $\sum_i(x_i-\bar{x})^2=0$. In that case, $x_i=c$ for all $i$, so that the regressor is just $c$ times the constant, so you get multicollinearity.

Then, the OLSE of the slope parameter is not well-defined: $$ \hat\beta_1=\frac{\sum_i(x_i-\bar{x})(y_i-\bar{y})}{\sum_i(x_i-\bar{x})^2} $$ Such a sample might look as follows: enter image description here Heuristically, it is quite intuitive that OLS breaks down here - $\hat\beta_1$ is supposed to tell you what happens to $y$ if $x$ changes. If your sample does not contain any variation in $x$, it is just not informative about that question.

To give an applied example, suppose you want to investigate the effect of additional labor market experience on earnings but all you observe is employees with exactly 15 years of experience - that sample is not going to tell you anything about the relationship of interest.

$\endgroup$
1
  • 5
    $\begingroup$ Honestly, I didn't understand anything than the first sentence, but thank you very much, that helped a lot. $\endgroup$ Dec 29, 2015 at 17:25

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.