# Why R uses IRLS and not Fisher Scoring?

I was wondering why R uses the Iterated Re-weighted Least Square in the GLM case?

When defining the problem analytically using Newton-Raphson / Fisher scoring, one comes to the following (vector notation):

$$\beta_{t+1} = \beta_t + (X^TWX)^{-1}X^TWM(y-\mu)$$

Then a "trick" is employed, to transform this to:

$$\beta_{t+1} = (X^TWX)^{-1}X^TW(X\beta_t + M(y-\mu)) := (X^TWX)^{-1}X^TWZ_t$$

And the solution is found using the Re-Weighted Least Squares algorithm.

I wonder why this extra trick/step is needed? Is it just because the algorithm used to solve RWLS is more efficient and numerically stable (uses QR decomposition)? Or is there some other underlying reason?

• I don't know the answer but john fox's book "compantion to applied regression" discusses the two approaches so the answer might be in there. Commented Feb 9, 2021 at 16:30
• @mlofton he barely mentions the topic. Commented Feb 9, 2021 at 19:33
• Hi: are you looking at the companion or the actual text. He went into it pretty deeply in the old version of CAR. Maybe he took it out of the updated version ? It definitely was in there back in say 2010. Commented Feb 10, 2021 at 15:49
• I'm looking into "An R Companion to Applied Regression" if that's what you meant... I can't find the answer there. Also looked at Generalized Linear Models 2nd edition by McCullagh and Nelder. But they don't explain either why they use IRLS... They just show that it's equivalent to Fisher-Scoring. My best guess so far is that there's already optimized code to solve Weighted LS, so they rather use that instead of writing new code just for this GLM Fisher-Scoring case, but I'm not sure. Commented Feb 10, 2021 at 16:04
• I did mean that. It could be an edition issue but maybe my recall ability of what book discusses what is failing !!!!! ( I'm getting old ). See if this helps at all and apologies that I led you in wrong direction. stats.stackexchange.com/questions/205/… Commented Feb 10, 2021 at 16:52