The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [irls]

IRLS stands for Iteratively Re-weighted Least Squares. IRLS is a commonly used method to find maximum likelihood estimates when they cannot be found analytically.

33 questions
Filter by
Sorted by
Tagged with
111 views

Are GLMs just glorified WLS regressions?

When performing weighted least squares $L = \frac{1}{2} \sum_i w_i r_i^2$, Aitken showed that one ought to weight each sample by the inverse of its variance $w_i=1/\sigma_i^2$. This leads to gradients ...
119 views

IRLS for truncated normal GLM

I have data for which responses fall in $y \in [0,\infty)$ for which, it seems, the standard GLMs based on, say, gamma or inverse-Gaussian fail since they don't allow responses with values equal to 0. ...
55 views

Can the maximum-likelihood method be derived from something else?

I am an author of a paper, in which we show that the maximum-likelihood (ML) method can be derived a limiting case of an iterated weighted least-squares fit. https://arxiv.org/abs/1807.07911 We, the ...
67 views

231 views

Iteratively reweighted least squares : asymmetric weights

For robust m-estimation, all the convergence results I'm aware of assume symmetric weights (eg: Huber function) in their formulation of the iterative reweighted least squares algorithm. Does the ...
4k views

Logistic regression: Fisher's scoring iterations do not match the selected iterations in glm

it happened to me that in a logistic regression in R with glm the Fisher scoring iterations in the output are less than the iterations selected with the argument <...
35k views

Purpose of the link function in generalized linear model

What is the purpose of the link function as a component of the generalized linear model? Why do we need it? Wikipedia states: It can be convenient to match the domain of the link function to the ...
2k views

Definition and Convergence of Iteratively Reweighted Least Squares

I've been using iteratively reweighted least squares (IRLS) to minimize functions of the following form, $J(m) = \sum_{i=1}^{N} \rho \left(\left| x_i - m \right|\right)$ where $N$ is the number of ...
I have build a $\rho$ function which has the following definition: \begin{equation} \rho(x)= \left\{ \begin{array}{ll} 4- \frac{8}{x^2} \text{if } x \lt-2\\ \frac{x^2}{2} \text{if } x \in [-2,3]...