Variance Inflation Factor (VIF) quantifies the severity of multicollinearity in an ordinary least squares regression analysis. It provides an index that measures how much the variance (the square of the estimate's standard deviation) of an estimated regression coefficient is increased because of ...

learn more… | top users | synonyms

4
votes
0answers
36 views

Variance inflation factor for generalized additive models

In the usual VIF calculation for a linear regression, each independent/explanatory variable $X_j$ is treated as the dependent variable in an ordinary least squares regression. i.e. $$ X_j = \beta_0 + ...
1
vote
0answers
25 views

Weeding out multi-collinear categorical variables

I have a huge amount of features that are categorical variables and I'm trying to find a system for weeding out categorical variables that are close to being multicollinear. Is vif a reasonable ...
2
votes
0answers
69 views

How to interpret the variance inflation factors?

I have run a Poisson glm and I want to test for multicollinearity in my data. I have used the vif in R and obtained the following result. How can I interpret this? ...
0
votes
0answers
27 views

calculate VIF for glmm

If we have colinearity among our axplanatory variables we can calculate a varianvce inflation factor to estimate the effects on our standard errors $$ VIF = 1/(1-R^2) $$ I am unsure how to calcuate ...
1
vote
1answer
51 views

Testing for multicollinearity in logistic regression

So far I have checked the tolerance value, VIF and condition indexes. But checking the variance of the regression coefficients I have to wonder: how little variance of the regression coefficient ...
0
votes
0answers
20 views

PCA, non positive definitive & potential cures?

I am trying to use PCA to remove the correlation in my dataset My correlation matrix is being reported as non positive definitive As I understand it a NPD report means that my transposed matrix does ...
2
votes
0answers
54 views

Question about variance inflation factors

I'm considering the regression model $y_i = \beta_0 + \beta_1x_{1i} + \beta_2x_{2i} + \varepsilon_i$ where the $\varepsilon_i$ are iid and $\mathcal N(0,\sigma^2)$ A study question asks to show the ...
0
votes
0answers
83 views

Adjust p-values for variance inflation factors

I'm fitting linear mixed models and I have slightly inflated p-values due to multicollinearity. I deleted the factors with the highest VIFs until none of them was larger than 3. The VIFs tell me, ...
4
votes
0answers
180 views

Which variance inflation factor should I be using: $\text{GVIF}$ or $\text{GVIF}^{1/(2\cdot\text{df})}$?

I'm trying to interpret variance inflation factors using the vif function in the R package car. The function prints both a ...
2
votes
0answers
63 views

What to do if a covariate is collinear in one model but not in another

I have 10 different species with presence/absences data, as well as 6 different covariates relating to the design of marinas, including 3 continuous (lengths of walls, pontoons and groynes) and 3 ...
3
votes
2answers
247 views

Is a log transformation of predictors a suitable way of dealing with multicollinearity in multiple regression?

Suppose two independent variables in the linear regression initially have very high correlation of 0.95. This introduces severe multicollinearity into the model (as indicated by very high variance ...
2
votes
1answer
594 views

Difference between Variance Inflation Factor (VIF) and kappa in R?

I am running a regression analyis in r: fit <- lm(Cost ~ Slope + YardDist, data = test) I want to test the two independent variables for multicollinearity. I ...
11
votes
1answer
915 views

Collinearity diagnostics problematic only when the interaction term is included

I've run a regression on U.S. counties, and am checking for collinearity in my 'independent' variables. Belsley, Kuh, and Welsch's Regression Diagnostics suggests looking at the Condition Index and ...
2
votes
1answer
327 views

How to solve collinearity problems in OLS regression?

Please see the model below (link to bigger image). The independent variables are properties of 2500 companies from 32 countries, trying to explain companies' CSR (corporate social responsibility) ...
3
votes
1answer
471 views

VIF values and interactions in multiple regression

I am running a multiple regression of the form y~a+b+c+ab+ac+bc I have checked the VIF values for the direct effects - should I check them for the interactions? I am assuming not as that would ...
1
vote
1answer
195 views

colinearity between variables

I am running a multiple regression of Y~a+b+c+d etc... I want to do a quick check to see whether my different explanatory variables are colinear (they're a mix of categorical and continuous). ...
4
votes
1answer
331 views

At what VIF level should you switch from OLS to ridge-regression?

Regarding multicollinearity, is it recommended to use ridge-regression if you have some covariates with VIF values around 10 in the OLS model? What would be the best VIF level to use to decide ...
10
votes
6answers
3k views

Multicollinearity when individual regressions are significant, but VIFs are low

I have 6 variables ($x_{1}...x_{6}$) that I am using to predict $y$. When performing my data analysis, I first tried a multiple linear regression. From this, only two variables were significant. ...
4
votes
1answer
324 views

VIF values in regression

Do high VIF values for a a particular variable $x$ just indicate that it is highly correlated with at least one of the other variables in the model? Does it specify which variables and how many ...
9
votes
2answers
6k views

VIF, condition Index and eigenvalues

I am currently assessing multicollinearity in my datasets. What threshold values of VIF and condition index below/above suggest a problem? VIF: I have heard that VIF $\geq 10$ is a problem. After ...