38
votes
Accepted
Can a confounding factor hide a possible causal relationship? (as opposed to find a spurious one)
Yes
Rephrasing the opposite of a confounder: It is definitely possible that an unobserved variable yields the impression that there is no relationship, when there is one.
Confounding usually refers ...
27
votes
Can a confounding factor hide a possible causal relationship? (as opposed to find a spurious one)
Following on existing answers, I wanted to give a concrete example. Imagine trying to figure out if the gas pedal affects the speed of a car. You observe how far the gas pedal is pressed and how fast ...
13
votes
Accepted
Difference Omitted Variable Bias and Confounding?
Omitted variable bias (OVB) is agnostic to the causal relationship between $X$ and $Z$. It concerns only the ability to estimate $\tau$ in the structural model for $Y$. The joint distribution of $Y$, $...
7
votes
Using a DAG to understand omitted variable bias in OLS vs Binary Dependent Variable Regression
You are confusing confounding and noncollapsibility. In logistic and probit models, the difference between the focal coefficient in a covariate-adjusted vs. unadjusted model is not due just to ...
7
votes
Accepted
Omitted variable bias vs. Multicollinearity
Usually, you would not care about both of them simultaneously. Depending on the goal of your analysis (say, description vs. prediction vs. causal inference), you would care about at most one of them.
...
6
votes
Can a confounding factor hide a possible causal relationship? (as opposed to find a spurious one)
First, I think you are mixing the usage of "correlation" and "causal relationship". They are different things. To discuss the differences, and how to find "causal relationship", we need a lot of ...
5
votes
Accepted
How is the omitted variable bias formula derived?
Here's an example of how one analyzes such a situation. Suppose that the model
$$E[Y\mid X_1,X_2] = \beta_1 X_1 + \beta_2 X_2$$
holds where $X_1,$ $X_2,$ and $Y$ are random $n$-vectors. If you omit ...
5
votes
Accepted
Omitted variable bias in ordered logistic regression query
Yes, the same holds true.
Note that omitted variable bias is an epistemic, not a technical problem. It means you lack a meaningful interpretation of results from a statistical model, e.g. ...
4
votes
Accepted
Omitted Variable Bias (OVB) and multicollinearity
This is a good question. The confusion stems from the "assumption" of no multicollinearity. From the Wikipedia page on multicollinearity:
Note that in statements of the assumptions ...
3
votes
Accepted
What would it take for the omitted-variable bias from multiple omitted variables to cancel out?
Expanding on the comment as an answer. First write the true model as
$$ Y_i = X_{1i}^T\beta_1 + X_{2i}^T\beta_2 + \epsilon_i \tag{1}$$
where $X_{1i}$ is a $K_1 \times 1$ vector of covariates (resp. ...
3
votes
Adjusting for confounding in linear regression model
The "omitted variable bias formula" as stated in Stock and Watson, Introduction to Econometrics (also available at https://www.econometrics-with-r.org/6-1-omitted-variable-bias.html) says ...
2
votes
Does confounding always imply endogeneity?
I would say no. Confounding per se could be endogenous, or it might not be. But if the confounding variable is measured, then it's no longer endogeneity. Here's an example of endogenous confounding:
...
2
votes
Omitted variable bias vs. Multicollinearity
If your goal is inference, multicollinearity is problematic. Consider multiple linear regression where the beta parameters help us estimate the increase or decrease in Y for a unit increase in X1, all ...
2
votes
My instrument (z) only affects y through x, but y affects z directly. Is my instrument valid?
If it is the case that $Y$ affects $Z,$ then $Z$ cannot be an instrument. By definition, an instrumental variable has to be $d$-separated from $Y$ in $G_{\alpha}$ and $d$-connected to $X.$ Your ...
2
votes
Difference between the concept of omitted variable bias in econ and epidemiology/social sciences (Elwert and Winship)
Omitted variable bias is very specific and refers to the bias in the parameter $\beta$ when omitting the variables $Z$ from a regression model of the following form:
$$Y = \alpha + X\beta + Z\gamma + \...
2
votes
Accepted
Omitted variable problem
Start with
$$y=\beta_0 +\beta_1 x_1 + ... + \beta_k x_k + \gamma q +\epsilon.$$
Say that the mean value of $q$ is $\bar q$. Then centering $q$ around its mean gives $q_c=q-\bar q$. Substitute into the ...
1
vote
What would it take for the omitted-variable bias from multiple omitted variables to cancel out?
One could assume (essentially a special case of Yashaswi's +1 answer) a structural model like
$$
y=\beta_0+\beta_1x+\beta_2w_1+\beta_3w_2+u,
$$
where $Cov((x,w_1,w_2)'u)=0$ and interest is on $\beta_1$...
1
vote
Accepted
Omitted variables problem
Section 4.1 of the Wooldridge text describes what's being considered:
The correlation of explanatory variables with unobservables is often due to self-selection: if agents choose the value of [...
1
vote
Adjusting for confounding in linear regression model
It depends on the substantive nature of the relationship between the confounder and the other variables. Here's one example
Let's say that you are running a model trying to predict income as a ...
1
vote
Accepted
Endogeneity coming from omitted variable vs measurement error
I don't know if I'm the best to explain this but I'll give it a go. A measurement error is, for instance, when the person was supposed to code you as LFG in a dataset, but coded you as GFL. So then ...
1
vote
Should I adjust for a confounder when it is colinear with a predictor?
that's not a bug that's a feature, you just showed that when you control for x2, x1 has no effect on y, which is exactly what you wanted to know. Good job.
You also learned that x1 is highly ...
1
vote
Accepted
Trade-off between omitting variables or dropping observations in multivariate logistic regression
This is an unnecessary trade-off, as data don't have to be "missing completely at random" (MCAR) to include cases with missing values in the analysis. In practice, you often have data "...
1
vote
Accepted
Is omitted variable bias possible with a perfectly correlated dependent and independent variable?
Yes, because omitted variable bias depends on the underlying causal question you want to ask.
Suppose you are interested in explaining the causal effect of schooling on earnings (just to give an ...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
omitted-variable-bias × 35regression × 19
bias × 8
econometrics × 7
confounding × 7
endogeneity × 6
causality × 5
least-squares × 4
multicollinearity × 4
instrumental-variables × 4
mathematical-statistics × 3
multiple-regression × 3
linear-model × 3
correlation × 2
mediation × 2
controlling-for-a-variable × 2
time-series × 1
hypothesis-testing × 1
self-study × 1
generalized-linear-model × 1
variance × 1
predictive-models × 1
regression-coefficients × 1
missing-data × 1
goodness-of-fit × 1