# What does it say about the data if ridge regression is not reducing multicollinearity?

I am predicting the salary to be offered to a new candidate for which I am concentrating on just continuous (9 in number) variables. Variables are as attached. When I ran OLS the coefficient for total experience came out negative but it is not expected to have a negative coefficient for total experience when "salary to be offered" is the dependent variable. Then, I removed the current salary and then ran OLS and the coefficient of total experience turned positive.

This clearly aligns with the fact that current salary and total experience are correlated therefore multicollinearity is present. Now I can't drop the variables because they are important.

I intend to build a linear equation that can explain the impact of every important predictor on the dependent variable and I thought ridge regression can help me with this problem but even in the presence of ridge regression the sign of the coefficient for total experience is negative which I think implies the multicollinearity is still present.

But even after ridge regression, the sign of the coefficient for total experience is negative.

In other words, shrinkage of the coefficients is not happening.

Can anyone suggest what might have happened?

• A side note: before applying OLS, it is apt to investigate the presence of multicollinearity and other anomalies, not the reverse. Commented Aug 28, 2022 at 11:20
• Commented Aug 28, 2022 at 11:22
• Unexpected sign if the coefficient is not a sign of multicollinearity. What exactly is the problem in here? Why does it bother you?
– Tim
Commented Aug 28, 2022 at 12:38
• Is this an ML exercise or an actual project you are working on? In many countries there are regulations against pay discrimination and ML algorithms are not exactly known for their fairness and unbiasedness. Commented Aug 28, 2022 at 16:02
• (1) Ridge regression does not remove multicollinearity but provides more stable estimators in case of multicollinearity. (2) The term "shrinkage" refers to the absolute value of coefficients rather than their sign. Did ridge regression reduce the absolute value of the coefficient or not? (3) "but it is not expected to have a negative coefficient for total experience when "salary to be offered" is the dependent variable" - why not? As Dave explained in his answer, having the current salary in the model may well have the effect that given this experience has a rather negative influence. Commented Aug 28, 2022 at 16:04