# Questions tagged [variance-inflation-factor]

Variance Inflation Factor (VIF) quantifies the severity of multicollinearity in an ordinary least squares regression analysis. It provides an index that measures how much the variance (the square of the estimate's standard deviation) of an estimated regression coefficient is increased because of collinearity.

210 questions
Filter by
Sorted by
Tagged with
27 views

194 views

### Fixed Effects causes Multicollinearity

I have a question regarding my regression model and would be grateful for any help. I have a dataset that contains every tranche of a Deal (a Deal may contain multiple Tranches) and its Variables like ...
25 views

### High vif after squaring the regressors

If I have 2 regressors in regression, with low vif (less than 5 for each of them), after squaring them, the vif increased significantly (more than 10), in the course, we haven’t covered how to fix ...
43 views

### Is using VIF to Select Lambda in Ridge Regression a valid approach?

I recently came across an article that suggests selecting the lambda parameter in ridge regression based on Variance Inflation Factor (VIF) values. The method aims to choose a lambda that ensures all ...
20 views

### Unusually High Variance in a Nested Model

I have a dataset containing lizard home range estimates and several environmental variables. My end goal is to create a model that uses the best combination of environmental variables to predict home ...
357 views

### What's the difference between a beta coef. estimate from linear regression and a VIF value?

I'm having trouble deciding what to do when two important variables (important to my research questions) are seemingly too related, but both need to be included in a full model (this is a longitudinal ...
• 1,689
20 views

### Design Effect in Cluster Randomised Trials

I want to understand why and how variance inflation factor is taken in account with the formula [1+(m-1)*ICC], where M= Size of clusters and ICC is the intracluster correlation. As I have deduced till ...
1 vote
80 views

### Using step() and car::vif(): order matters?

When fitting linear models and coming up with a plausible one, AIC and VIF are often used. However, I notice that the order in which the methods are used makes a difference on the final model. Should ...
• 1,579
50 views

### Introducing ln variables causes VIF to increase above 10

I am running a regression like this on Stata to do model diagnostics: xtreg lnTobinsQ l.ESGScore l.lnTotalAssets l.Leverage l.CurrentRatio l.PricetoBookValueperShare, fe When I run the command vif, ...
• 1
46 views

### Variance Inflation Factor for 2 categorical variables is coming to be greater than 5, can I drop one of them?

I am practicing Linear Regression on the Airbnb dataset. The VIF for 2 dummy variables 'room_type_Entire home/apt' and 'room_type_Private room' is coming as '9.546159' and '9.116464'. These dummy ...
• 13
27 views

### How to proceed when correlation plot doesn't show as much multicorrelation as is seen by statsmodels variance_inflation_factor in a regression task?

I am working with the kaggle Blueberry Yield prediction dataset. There are 17 columns including the target variable. Below is the correlation heat map: It can be seen that multiple features are ...
• 101
587 views

### If VIF value is greater than 5,

I am running a binomial logistic regression with a dependent variable is 0/1 and the explanatory variables are categorical - binary and multiple categories. When I add an interaction term, and run a ...
• 19
1 vote
293 views

### GVIF in binomial logistic regression

I am running vif(model) to identify multicollinearity between predictor variables in the model. Is there a rule of thumb on the gvif value that indicates presence of multicollinear variables?
• 111
501 views

### VIF, SMC and the inverse of the correlation matrix

The Variance Inflation Factor (VIF) is defined to be: $$VIF_p = \frac{1}{1-R_p^2}$$ where $R_p^2$ is the $R^2$ calculated when $X_p$ is the dependent variable, and all the other variables are ...
• 3,520
1 vote
56 views

### If we have a binary variable in our linear regression, the VIF for its coefficient estimate uses the $R^2$ of a linear probability model. What gives?

The variance inflation factor (VIF) in an ordinary least squares linear regression coefficient is calculated using the $R^2$ of a linear model that uses the other features to predict the feature to ...
• 64.7k
429 views

### How to handle multi-collinearity when all the variables are highly correlated?

In my dataset, all the variables are highly correlated (correlation coefficient > 0.95). However, the correlation with the dependent variables is very low (<0.35). I checked the variation ...
• 145
1 vote
1k views

### Multicollinearity and Interaction Effects

I know similar questions were asked before. However, none of the existing answers help me with my problem: I have a gls model with y=B0+B1X1+B2X2+B3X1X2+e. The VIF value for X1 and the interaction ...
• 11
1 vote
248 views

### Using VIF (variance inflation factor) to reduce the data set and account for multicollinearity decreases the r2 and the performance of my model

Currently I am working on three models to predict the personality factors of subjects according to three data sets. All three data sets are exported features from video interviews, i.e. audio features,...
• 13
121 views

### High Adj. $R^2$ (by economic data standards) but insignificant p-values

I'd like to start by saying I'm not a statistician - I have stats education at the Masters level, but no specialization or advanced work experience. I'm currently trying to regress financial return ...
• 31
1 vote
246 views

### Intercept variance inflation factor?

In the comments to the question here, John Madden remarks about the variance inflation factor (VIF) of the intercept of a linear model. Does such a notion exist? My argument against such a notion is ...
• 64.7k
1 vote
465 views

### Regression model has very high const VIF value where as the other features have value between less than 4. Should I drop const?

I am a beginner in modelling. I have created a linear regression model using statsmodel and I see the const has VIF value around 124 where as the other features have value around 4. I already referred ...
1 vote
667 views

### Multicollinearity for ordered logistic regression

How is multicollinearity calcuated for an ordered logistic regression if R^2 is not determined for this type of regression? Because the formula for vif says: 1/(1-R^2) In R the looking up ...
• 65
183 views

### How does variance-inflation factor creep into a chunk test?

In this question, the OP runs a “chunk test” and has a linear relationship between a variable in the restricted model and the variables in the chunk. If this were a chunk of just one variable, that ...
• 64.7k
949 views

### Logistic regression: How to improve the pseudo-$R^2?$

Firstly, I would like to ask you opinion about my model: I have a logistic regression model where the dependent variable is late payments (1=late/0=not late) and diesel prices and interest rates as ...
72 views

### Variance inflation factors not equal to $C_{jj}$

I am following a book which states that the diagonal elements of $C = (X'X)^{-1}$ are called the variance inflation factors: $$VIF_j = C_{jj} = \frac{1}{1-R^2_j}$$ where $R^2_j$ is the coefficient ...
• 685
1 vote
360 views

### VIF after LASSO?

In have been working on a project along with other colleagues in which the dataset has almost 100 variables. The earlier approach was to use LASSO for subset selection and then use VIF to remove the &...
1k views

### Does multicollinearity among control variables matter?

I am conducting a regression analysis between $X$ and $Y$, where $X$ is the main independent variable. However, I want to control for several variables that are related to $Y$. For example, my ...
• 245
1 vote
52 views

### Is it possible to create a 0 intercept ridge regression model?

I am working on implementing ridge regression for market mix modeling where I wish to use my own create base(UCM) instead of intercept, I had been using linear regression for this purpose but now my ...
• 21
70 views

### Checking for significant associations between a mixed set of predictors prior to running a conditional random forest model

I am running a conditional random forest model using the party package in R, with the goal of quantifying variable importance (permutation importance) for 29 predictor variables. My response variable ...
• 21
4k views

### What to do when every VIF value is infinity

I know that VIF values have no upper limit, and that anything over 10 is usually bad news if you are trying to avoid multicollinearity especially for regression models such as multiple logistic ...
1 vote
412 views

### VIF - but with a categorical response variable?

I've seen a tonne of tutorials online for managing categorical variables in a VIF test by making binary dummy variables, but with a variable with 3 or more categories this means creating two or more ...
1 vote
119 views

### Batchwise Variance Inflation Factor Calculation for Feature Selection

I am currently working on a research project that involves interpretation of coefficients from a fitted Cox Proportional Hazards model. Unfortunately, the features within my model exhibit high ...
98 views

### Multiple Regression - VIF

could anyone help me with my problem - I’m a beginner. When doing multiple regression and checking for multicollinearity, I have found 2 VIF’s of 17, however, I’ve done some reading and few say it is ...
15 views

### Average VIF after dummy variables [duplicate]

I have classified (label encoding) independent variables. To calculate VIF, I converted them to dummy variables. When I calculate VIF for dummy variables, there are VIF values for each class of an ...
1 vote
149 views

### How to Assess Multicollinearity for Independent Count and Rate Variables

How do I test an independent variable for multicollinearity if it comes from a Poisson or Negative Binomial distribution? A common approach for testing the multicollinearity of a model's independent ...
• 227
36 views

### Theoretical backing for VIF

I'm giving a lecture in machine learning class covering linear regression, and wanted to briefly touch up on the idea of multicollinearity since I come from a more traditional stats background. I was ...
• 1
865 views

### PCA can make VIF worse? Why is it so often sold as a multicollinearity fix?

It's the conventional wisdom that a PCA transformation can cure multicollinearity. Putting this into practice on example data, I find myself confused. In the following case, applying PCA seems to have ...
494 views

### VIFs in Fixed-Effects-model

I know that R is providing some Warnings messages when you try to get your VIFs to test for multicollinearity. But why is that? Does someone know a good paper or the answer itself? CODE: ...
1k views

### Which threshold should I use for GVIF1/(2⋅df)? (Variance Inflation Factor)

I'm using the mtcars dataset in R, I used the car packages to estimate the VIF, but since I have factor variables I got the vif table with GVIF and GVIF1/(2⋅df) values, in another question Which ...
632 views

### Is there any way to determine VIF of some variable that is included in the dataset that has so many variables?

I am new in statistics and need some help to determine the VIF value on all my variables/features in the dataset with a lot of variables. I have 98 variables with 76 observations and need to find VIF ...
• 41
1 vote