Linked Questions
16 questions linked to/from Why is the intercept in multiple regression changing when including/excluding regressors?
14
votes
5
answers
5k
views
What are the differences between "Marginal Probability Distribution" and "Conditional Probability Distribution"?
While studying probability, I am kind of having difficulties in understanding marginal probability distribution and conditional probability distribution. To me, they look much the same and cannot find ...
- 3,585
6
votes
3
answers
1k
views
Why is the intercept changing in a logistic regression when all predictors are standardized?
I'm conducting a logistic regression in R using glm. My outcome is race (White = 0, Black = 1). The data are below:
...
- 161
5
votes
2
answers
1k
views
'Size' of intercept at linear regression
I have a question about this table.
Why does the constant (intercept) change so dramatically from Model 1 to Model 2?
- 51
4
votes
4
answers
3k
views
Why is the intercept different from the mean of Y when X=0?
I was hoping to find here a solution to some aspects of linear regression I had trouble understanding.
Let's take an example of regression with the following variables:
$y:\:$ depression (continuous)...
- 107
4
votes
4
answers
2k
views
When does the standard errors of OLS estimates decreases when we have more explanatory variables?
So far my understanding is that standard errors of $\hat\beta_j$ increase when we have more independent variables in the regression model because variation among those independent variables will ...
- 335
2
votes
2
answers
12k
views
Why, or why not, factor categorical variables in regression modeling?
I'm currently in the midst of running several logistic regression models to test for effect modification (i.e., testing interaction terms) between two categorical variables (sex and age as a ...
- 23
4
votes
2
answers
395
views
Interpreting when a regression coefficient is significant
Consider the following regression model:
$y_i=\beta_1+\beta_2x_{i,2}+\beta_3x_{i,3}+\beta_4x_{i,2}x_{i,3}+\epsilon_i,$
where $\epsilon_i\sim N(0,\sigma^2).$ Here, $x_2$ is binary variable
$$X_2 =
\...
- 309
3
votes
2
answers
3k
views
Why and how does adding an interaction term affects the confidence interval of a main effect?
I was wondering why, in a regression model including an interaction term, the confidence interval of one of the main effects becomes wider.
Consider this Cox regression, where the variable IR_BMI27 ...
- 305
1
vote
3
answers
596
views
Regression coefficients do not match conditional means
In a nutshell, I want the regression coefficients of a model to match several differences in conditional means.
You can download the data from this repo.
I have a data set that has a dependent ...
- 569
6
votes
2
answers
530
views
Why do my (coefficients, standard errors & CIs, p-values & significance) change when I add a term to my regression model?
Lots of people seem to be asking this. They often seem to get shallow answers that merely assert what is true, instead of drawing or explaining the mechanism. They also seem to not find each other -- ...
- 5,288
4
votes
2
answers
2k
views
why does the same variable have a different slope when incorporated into a linear model with multiple x variables
When I call for the summary of my linear model it shows X2 to have a negative slope. But
when i call the same variable in a linear model of its own it has a positive slope. why is it not just the same ...
- 81
2
votes
1
answer
430
views
Both variables of my GLMM output are significant. Don't know how to interpret it?
This is more of an interpretation question than anything. I have run a GLMM with two fixed factors (both of which have two levels) and two random factors. The outputs from the model are as such:
<...
- 43
2
votes
1
answer
376
views
What does the intercept mean in a car ANOVA output?
I've just carried out an ANOVA using the Anova function in the package car, with type III sums of squares and got the following ...
- 41
0
votes
1
answer
210
views
Is the intercept fit differently for each regressor in Multiple Linear Regression?
is the intercept B0 in y = B0 + B1X1 + .... fit differently for every feature x1.
Is it different for every feature coefficient or the same for all feature coefficients and why so?
- 11
2
votes
1
answer
139
views
Using random intercepts or z-standardizing within factors: Two identical ways to account for variance between factors?
I have the following (simple?) question about statistics: I have a dataset where I look for correlations between variables and would like to control for differences between factor levels. For ...
- 21