5
$\begingroup$

I've calculated a single variable linear regression using OLS (in the python statsmodels library).

The model has a large condition number, and suggests there may be multicollinearity.

I don't understand how there can be multicollinearity in a single variable model (unless it is multicollinearity the intercept, I guess implying too many of my data points are equal to 1?).

Either way, my understanding of condition numbers, especially as they pertain to regression models, is fuzzy, and wikipedia seems rather blank on the subject.

$\endgroup$
2
  • 5
    $\begingroup$ Try centering your independent variable $x$, and see what happens the condition number. Since you just have a two-dimensional design, the condition number will be closely related the to dot product of $\mathbf{x} \mathbf{1} = \sum x$. How does that change when you center $x$? $\endgroup$
    – Andrew M
    Nov 14, 2014 at 0:46
  • $\begingroup$ @AndrewM If I saw something along those lines as an answer, I'd upvote it. $\endgroup$
    – Glen_b
    Nov 14, 2014 at 2:56

1 Answer 1

1
$\begingroup$

Answered in comments: Try centering your independent variable $x$, and see what happens the condition number. Since you just have a two-dimensional design, the condition number will be closely related the to dot product of $\mathbf{x} \mathbf{1} = \sum x$. How does that change when you center $x$? – Andrew M

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.