Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

I want to know why logistic regression is called a linear model. It uses a sigmoid function, which is not linear. So why is logistic regression a linear model?

share|improve this question
2  
The logit of $\pi$ (the log of the odds) is linear in the parameters, but people don't refer to logistic regression as linear as far as I know. Can you cite who has said this? –  gung Mar 3 at 18:05

3 Answers 3

The logistic regression model is of the form $$ \mathrm{logit}(p_i) = \mathrm{ln}\left(\frac{p_i}{1-p_i}\right) = \beta_0 + \beta_1 x_{1,i} + \beta_2 x_{2,i} + \cdots + \beta_p x_{p,i}. $$ It is called a generalized linear model not because the estimated probability of the response event is linear, but because the logit of the estimated probability response is a linear function of the predictors parameters.

More generally, the Generalized Linear Model is of the form $$ \mathrm{g}(\mu_i) = \beta_0 + \beta_1 x_{1,i} + \beta_2 x_{2,i} + \cdots + \beta_p x_{p,i}, $$ where $\mu$ is the expected value of the response given the covariates.

Edit: Thank you whuber for the correction.

share|improve this answer
5  
If you were to write "generalized linear" instead of "linear" and parameters instead of predictors, this would be correct. (Many logistic regression models are not linear in the predictors. For instance, no logistic regression with an interaction term will be linear in the prdictors.) –  whuber Mar 3 at 18:42
    
You are correct, thank you. I've updated my answer to reflect this. –  P Schnell Mar 3 at 18:55

Logistic regression uses the general linear equation $Y=b_0+∑(b_i X_i)+\epsilon$. In linear regression $Y$ is a continuous dependent variable, but in logistic regression it is regressing for the probability of a categorical outcome (for example 0 and 1).

The probability of $Y=1$ is: $$ P(Y=1) = {1 \over 1+e^{-(b_0+\sum{(b_iX_i)})}} $$

share|improve this answer

Linear means linear in betas (the coefficients) but no in x's (the independent variables), so as long as your betas are not non-linear, your model is linear.

share|improve this answer
1  
That's true--but unfortunately logistic regression is a generalized linear model and it is not linear in the parameters. –  whuber Mar 3 at 18:44

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.