152k views

### When is it ok to remove the intercept in a linear regression model?

I am running linear regression models and wondering what the conditions are for removing the intercept term. In comparing results from two different regressions where one has the intercept and the ...
273k views

### What's the difference between correlation and simple linear regression?

In particular, I am referring to the Pearson product-moment correlation coefficient.
61k views

### Removal of statistically significant intercept term increases $R^2$ in linear model

In a simple linear model with a single explanatory variable, $\alpha_i = \beta_0 + \beta_1 \delta_i + \epsilon_i$ I find that removing the intercept term improves the fit greatly (value of $R^2$ ...
19k views

### Why do we need multivariate regression (as opposed to a bunch of univariate regressions)?

I just browsed through this wonderful book: Applied multivariate statistical analysis by Johnson and Wichern. The irony is, I am still not able to understand the motivation for using multivariate (...
5k views

### What does the formula y ~ x + 0 in R actually calculate?

What is the statistical difference between doing a linear regression in R with the formula set to y ~ x + 0 instead of ...
10k views

### Why does statsmodels.api.OLS over-report the r-squared value?

I am using statsmodels.api.OLS to fit a linear regression model with 4 input-features. The shape of the data is: ...
49k views

### Test for cointegration between two time series using Engle–Granger two-step method

I am seeking to test for cointegration between two time series. Both series have weekly data spanning ~3 years. I am trying to do the Engle-Granger Two Step Method. My order of operations follows. ...
11k views

### transformation to normality of the dependent variable in multiple regression

Is it really important to normalize dependent variables in multiple regression or are there any exceptions? My model is providing better results with more significant hypothesis when the DVs are not ...
10k views

### What is the point in regression through the origin? [duplicate]

I am doing the Coursera Statistics Inference course and one of the questions is to find the regression through the origin, when the regression line has an intercept. Can you please explain what the ...
14k views

### What to do when a linear regression gives negative estimates which are not possible

I am using linear regression to estimate values that in reality are always non-negative. The predictor variables are also non-negative. For instance, regressing the number of years of education and ...
9k views

### Interpreting a negative intercept in linear regression

This is my first time of having a negative intercept, so I'm a bit confused. My line of regression is: $$\text{starting monthly income} = -7.5 + 0.75\times \text{years of education}.$$ How would ...
1k views

### Analytical solution of a simple regression with fixed intercept

I would like to know how to find out the analytical solution of a simple linear regression with fixed intercept = 0: $$s = e^{-ht}$$ $$y = -ln(s) = h\cdot t$$ Here ist the background: I have ...
2k views

### How do you set your own intercept in SPSS? [duplicate]

I am trying to specify the constant in a regression model using SPSS. Does anyone have an idea on how to do this?