16
$\begingroup$

I always have a hard time explaining statistical techniques to audience with no statistical background. If I wanted to explain what GLM is to such audience (without throwing out statistical jargon), what would be the best or most effective way?

I usually explain GLM with three parts -- (1) the random component which is response variable, (2) the systematic component which is linear predictors, and (3) the link function which is the "key" to connecting (1) and (2). Then I would give an example of linear or logistic regression and explain how the link function is selected based on the response variable. Hence it acts as the key connecting two components.

$\endgroup$
5
  • $\begingroup$ What kind of background do the audience have? Explaining GLM to a mathematician or a biologist is very different. $\endgroup$
    – user10525
    May 3, 2012 at 16:17
  • 1
    $\begingroup$ There will be few mathematicians with no statistical background, @Procrastinator. But your point is a good one: having a clearer idea of the intended audience will help keep the replies consistent and focused. Would you mind editing the question to expand on this, Ken? $\endgroup$
    – whuber
    May 3, 2012 at 17:44
  • 1
    $\begingroup$ I see your point, @Procrastinator but I was hoping to get an easy-to-understand answer for everyone (mathematicians and/or biologists), in general because if I don't have math or biology background (which is the case), I wouldn't know how to explain GLM to them with respect to their background anyway. $\endgroup$
    – Ken
    May 3, 2012 at 18:12
  • 7
    $\begingroup$ I think it's important to keep in mind that you can get a bachelor's, a master's, or even a doctorate in biology without ever having taken a statistics class, even at many tier one universities. My degree in biochemistry required two semesters of introductory calculus and one semester of differential equations. The substance of these classes is quickly forgotten because many students will never use these skills again! So I really do think it's necessary to dumb down the explanation for typical non-statisticians. $\endgroup$
    – Alexander
    May 3, 2012 at 19:11
  • $\begingroup$ A comment to add to the answers below; if you can get across fitting a line (i.e. the link function and linear predictors) then the connection to efficient inverse-variance weighting is not so hard to communicate; we simply want to upweight precise contributions and downweight the rest. This lets you avoid saying anything too technical about the randomness of the outcomes. NB GLMs were devised as (just) the models where IWLS can be used to give the MLE, so the way of thinking about them described above captures most of why they're actually useful. $\endgroup$
    – guest
    May 4, 2012 at 6:38

2 Answers 2

29
$\begingroup$

If the audience really has no statistical background, I think I would try to simplify the explanation quite a bit more. First, I would draw a coordinate plane on the board with a line on it, like so:

y = mx + b

Everyone at your talk will be familiar with the equation for a simple line, $\ y = mx + b $, because that's something that is learned in grade school. So I would display that alongside the drawing. However, I would write it backwards, like so:

$\ mx + b = y $

I would say that this equation is an example of a simple linear regression. I would then explain how you (or a computer) could fit such an equation to a scatter plot of data points, like the one shown in this image:

Scatter plot

I would say that here, we are using the age of the organism that we are studying to predict how big it is, and that the resultant linear regression equation that we get (shown on the image) can be used to predict how big an organism is if we know its age.

Returning to our general equation $\ mx + b = y $, I would say that x's are variables that can predict the y's, so we call them predictors. The y's are commonly called responses.

Then I would explain again that this was an example of a simple linear regression equation, and that there are actually more complicated varieties. For example, in a variety called logistic regression, the y's are only allowed to be 1's or 0's. One might want to use this type of model if you are trying to predict a "yes" or "no" answer, like whether or not someone has a disease. Another special variety is something called Poisson regression, which is used to analyse "count" or "event" data (I wouldn't delve further into this unless really necessary).

I would then explain that linear regression, logistic regression, and Poisson regression are really all special examples of a more general method, something called a "generalized linear model". The great thing about "generalized linear models" is that they allow us to use "response" data that can take any value (like how big an organism is in linear regression), take only 1's or 0's (like whether or not someone has a disease in logistic regression), or take discrete counts (like number of events in Poisson regression).

I would then say that in these types of equations, the x's (predictors) are connected to the y's (responses) via something that statisticians call a "link function". We use these "link functions" in the instances in which the x's are not related to the y's in a linear manner.

Anyway, those are my two cents on the issue! Maybe my proposed explanation sounds a bit hokey and dumb, but if the purpose of this exercise is just to get the "gist" across to the audience, perhaps an explanation like this isn't too bad. I think it's important that the concept be explained in an intuitive way and that you avoid throwing around words like "random component", "systematic component", "link function", "deterministic", "logit function", etc. If you're talking to people who truly have no statistical background, like a typical biologist or physician, their eyes are just going to glaze over at hearing those words. They don't know what a probability distribution is, they've never heard of a link function, and they don't know what a "logit" function is, etc.

In your explanation to a non-statistical audience, I would also focus on when to use what variety of model. I might talk about how many predictors you are allowed to include on the left hand side of the equation (I've heard rules of thumb like no more than your sample size divided by ten). It would also be nice to include an example spread sheet with data and explain to the audience how to use a statistical software package to generate a model. I would then go through the output of that model step by step and try to explain what all the different letters and numbers mean. Biologists are clueless about this stuff and are more interested in learning what test to use when rather than actually gaining an understanding of the math behind the GUI of SPSS!

I would appreciate any comments or suggestions regarding my proposed explanation, particularly if anyone notes errors or thinks of a better way to explain it!

$\endgroup$
4
  • 5
    $\begingroup$ Not everyone is familiar with the equation for a line; not even all graduate students are, nor all people with PhDs. $\endgroup$
    – Peter Flom
    May 3, 2012 at 20:20
  • 6
    $\begingroup$ I mean, I'm sure a graduate student exists out there in the world who doesn't know the equation for a line, but presumably an audience to which you would want to explain generalized linear models would at least have half a clue about high school level algebra! :-o $\endgroup$
    – Alexander
    May 3, 2012 at 22:35
  • 1
    $\begingroup$ I agree with you Alexander and your approach seems very natural to me. I wouldn't focus on the "g" of the glm too much (or too early) and would also not go into distinctions on random vs fixed. Of course it depends on the amount of time you have to explain all this. $\endgroup$ May 4, 2012 at 2:41
  • $\begingroup$ You could also explain the $Y = \alpha X + \beta$ form as I have: "For every 1 this(X) goes up by, this(Y) goes up by $\alpha$". $\endgroup$
    – Eoin
    Jul 7, 2014 at 14:47
12
$\begingroup$

I wouldn't call the response a random component. It is a combination of a deterministic and a random component.

I think I would describe generalized linear models this way. We have a response variable and a set of related variables that can aid in predicting the response. However the response and the predictors are not linearly related. The link function provides a transformation of the response so that the transformed response is linearly related to the predictors. For example in logistic regression the predictor could be continuous variables that can take on values over the entire real line. But the response is a probability (the probability of a successful outcome in a clinical trial for example). So the response is constrained to fall between 0 and 1. The link function in logistic regression is called the logit function. It equals $\log(p/(1-p))$. You can see that the logit function transforms a variable constrained to $[0,1]$ to a variable that can take values over the entire real line. In this case the link function makes the response compatible with the predictor variables and hence it is possible to make it a linear function of the predictors plus a random component.

$\endgroup$
2
  • 3
    $\begingroup$ I wonder about this use of "response." Our intended audience would likely understand that to mean the observed response: yes or no, 0 or 1, etc. In logistic regression we model something unobserved (and never directly observable); namely, the hypothetical chance of the response. The "link" merely is a matter of expressing those chances as log odds rather than as probabilities. Logistic regression assumes the log odds vary linearly with the IVs. (My use of "model," "assume," and "hypothetical," rather than "is" and "predict," indicates a different cognitive and ontological viewpoint, too.) $\endgroup$
    – whuber
    May 3, 2012 at 17:41
  • 2
    $\begingroup$ Good point whuber. $\endgroup$ May 13, 2012 at 21:54

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.