0
$\begingroup$

I am debating this with some friends at the moment and would like to know what the stack exchange community can add to this discussion.

When selecting the choice of the distribution and link function, some say that it is less important, even if the outcome variable does not follow the selected distribution. I beg to differ, because this would invalidate all statistical results obtained from the glm. However, it seems that this is quite common to ignore if the distribution just 'seems' to follow a particular distribution.

So, my question is, how important is it that the choice of the distribution is properly chosen? Hence, by making use of statistical test (e.g. ks test).

If anyone could also provide an example as to why this is/is not important I would appreciate it.

Thanks!

Improve this question
$\endgroup$
9
  • $\begingroup$ When we're talking about discrete distributions such as Bernoulli or Binomial the ks.test can tell you nothing more than you already know; there is a yes or no answer to whether or not they can be used. What kind of GLM did you have in mind? $\endgroup$
    – Digio
    Commented Jul 29, 2017 at 21:08
  • $\begingroup$ Hi, indeed, I was thinking more in lines of the continuous distributions... Gamma/normal $\endgroup$
    – Charl Francois Marais
    Commented Jul 29, 2017 at 22:04
  • $\begingroup$ Gaussian GLM with identity link is very much like Gaussian-noise linear regression with MLE. The distribution should be diagnosed on the residuals, not the response. Still, I think the other assumptions of linear regression on model structure and the residuals are more important than the distribution. So I'm afraid my opinion is closer to that of your friends. $\endgroup$
    – Digio
    Commented Jul 31, 2017 at 8:24
  • $\begingroup$ @Digio alright, this is something that is not entirely clear to me. What you are saying is that the choice of the distribution is made on the residuals and not the outcome variable? Hence, you will base your decision regarding the choice of the distribution only after you have fit the first model? $\endgroup$
    – Charl Francois Marais
    Commented Jul 31, 2017 at 9:10
  • $\begingroup$ Yes, a parametric model is based on assumptions and the validity of these assumptions can only be assessed a posteriori (after estimation). I would, however, use the term "choice of model" rather than "choice of distribution" since you start off by evaluating a model structure and not a distribution (this can be expanded even to discrete response GLM). $\endgroup$
    – Digio
    Commented Jul 31, 2017 at 9:45

0

Reset to default