Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 198058

Techniques for analyzing the relationship between one (or more) "dependent" variables and "independent" variables.

3 votes
Accepted

Regression Analysis with dependent observations

We can't include it in the regression as is, but you could create a dummy variable for all but one value of kettlehole and put those in your regression to effectively obtain the desired relationship within … In so doing, you've effectively run a Fixed Effects Regression. Entity fixed effects can control for variables that are constant over time but differ across entities (i.e. kettleholes). …
ColorStatistics's user avatar
0 votes
Accepted

To what extent does a Linear Probability Model (LPM) violate the Gauss-Markov assumptions?

.)=0 it means that you are assuming that the true population regression is: which, when y is binary, is equivalent to assuming that: which, in words, means you are assuming that the P(y=1|x) is a …
ColorStatistics's user avatar
1 vote
1 answer
90 views

Multicolinearity ONLY raises the variance of the coefficient estimates?

It is a logistic regression. All coefficients are statistically significant at the 5% level. I calculated the VIF for the set of predictors in the multiple regression model. …
ColorStatistics's user avatar
0 votes
0 answers
65 views

Is assuming independence of errors equivalent to assuming residuals and predicted values are...

The Penn State STAT200 course states that assuming that the errors are independent is equivalent to assuming that residuals $\hat{\epsilon}$ and predicted values $\hat{y}$ are not related, which I tak …
ColorStatistics's user avatar
2 votes
0 answers
58 views

Identification techniques when $E(u_i|\text{do}(X_i))\not=0$

In this article Chen & Pearl make the following 2 statements: "Identification techniques are available for models in which X is far from satisfying $E(u_i|X_i)=0$" in response to Stock & Watson's sen …
ColorStatistics's user avatar
5 votes
1 answer
2k views

Proof that Regression Sum of Squares and Residual Sum of Squares are independent random vari...

Having consulted a number of sources, I still can't find a complete proof that Regression Sum of Squares ($SS_{regression}$) and ($SS_{residual}$) are independent random variables. …
ColorStatistics's user avatar
4 votes

Is it possible to use generated non-normal errors with a linear regression model

Then you build a sample using this DGP and run a regression on this sample (can be linear regression or Huber or any other type). … This clarification of how regression simulation works should answer all your questions. …
ColorStatistics's user avatar
8 votes
3 answers
1k views

Can (some) linear regression model this (population) function accurately?

Keeping in mind the widespread misunderstanding that linear regression can only model linear relationships/missing the fact that linear regression refers to linearity in parameters and can accommodate … That is, (3.36) is simply a multiple linear regression model with $X_1=horsepower$ and $X_2=horsepower^2$. …
ColorStatistics's user avatar
10 votes

Regression and causality in econometrics

Second, run the regression, as usual. Now you know what to condition on. The coefficients you'll get would be the direct effects, as mapped out in your causal map. …
ColorStatistics's user avatar
0 votes

How do I forecast time series for which the range of residuals is increasing over time?

When the range of the residuals - as you saw it, or to use another measure of spread, the variance of residuals - changes over time, this is a symptom that goes by the name of heteroskedasticity, from …
ColorStatistics's user avatar
3 votes
Accepted

Is there a difference between perfect collinearity and multicollinearity?

No. If your regressors are perfectly collinear, OLS estimation is impossible. In contrast, the more multicollinear (high collinearity but not perfect) your regressors the more inefficient your estimat …
ColorStatistics's user avatar
4 votes
1 answer
334 views

What does size of coefficients have to do with multicollinearity or overfitting?

In the section on Ridge Regression (source: Elements of Statistical Learning by Hastie, Tibshirani, Friedman) : When there are many correlated variables in a linear regression model, their coefficients … We will now look at Ridge Regression, Lasso Regression, and Elastic Net, which implement three different ways to constrain the weights. …
ColorStatistics's user avatar
2 votes
Accepted

What kind of method would show the association between these two sets

The next step is to regress one series on the other one, and save the residuals from this regression. This residual is itself a time series. … stationary (use the same tests as you did above), then you conclude that the 2 variables are cointegrated, with the cointegration coefficient estimated to be the beta hat on the independent variable in the regression
ColorStatistics's user avatar
5 votes

How to tell the difference between linear and non-linear regression models?

Nonlinear vs. generalized linear model: How do you refer to logistic, Poisson, etc. regression? …
ColorStatistics's user avatar
8 votes
1 answer
1k views

Controlling for a variable in OLS - Stratification and Reaggregation. Simple Example

interesting, controlling for a variable by its inclusion in a regression is insightful but not a very intuitive answer. … Edit: To put some numbers behind it, with the completely made up data below, I obtain the following regression results: On the left are the results of the simple regression of weight on education (after …
ColorStatistics's user avatar

15 30 50 per page