Using generalized linear models over OLS and why do estimates differ?

Question

I am trying to fit a regression model in which the dependent variable is a continuous positive variable (costs, no zero costs). In literature I often read that considering the lack of negative values, a ordinary least square regression is not appropriate. Generalized linear models with for example a Gamma distribution is often recommended over OLS. This leads to the following questions

1. To get unbiased regression estimates the assumptions of the OLS do not specify anything regarding the specification of the error distribution. Hence, even though the errors are clearly not normally distributed, an ordinary least square regression would still provide you with unbiased estimates. In case the sample is sufficiently large and the errors are homoscedastic (or use robust standard errors when they are not), why would one prefer a glm?

2. I fitted a GLM with a gaussian family as well as with a Gamma distribution, with both the identity link function as well as the log link function. However, the regression estimates for the different families (with the same link function) are substantially different (even when considering robust standard errors). Given that both should give unbiased estimates why would this happen?
3. Some papers say that fitting non negative data with an identity link function is inappropriate as it might lead to negative predictions. However, when given the regression coefficients negative predictions are impossible would this still be argument? I am asking as I am interested in the additive effect of my variables. Moreover, the AIC of the Gamma regression with the identity link is the lowest. The error plots for the gamma regression with the identity link also look superior compared to the others.

Answer 1

This is a very broad question, and similar questions have been posted before. So this is mostly and enlarged comments giving links to earlier posts which can help you. But first, shortly, glm's are a modeling framework for many different regression models, and the choice mostly depends on your goals and what kind of parameters you find interpretable in your context. AS to the question in title, estimated differ because this are different models!

So:

• How does OLS regression relate to generalised linear modelling

• What are the differences between ANOVAs and GLMs?

• General Linear Model vs. Generalized Linear Model (with an identity link function?)

• Goodness of fit and which model to choose linear regression or Poisson

(many other relevant posts, search our site)