Can a generalized linear model use shifted exponential as residual distribution?

Question

I am facing a modeling problem:

$t_{ij} = D_i + T_j + \epsilon_{ij}, i=0...641, j\in\mathbb{N}$

where $\epsilon_{ij}$ follows exponential distribution,

$\epsilon_{ij} \sim \lambda e^{-\lambda t}, \lambda \approx 1/26 \mathrm{ns}$.

---

If $\epsilon_{ij}$ is treated as normal, the problem can be modeled as ANCOVA. For example in R:

# i and j are categorical (factors in R)
lm(t ~ i + j, data)

It works as a good approximation, but the residual plot is highly skewed. I am thinking of treating $\epsilon_{ij}$ as exponential.

In terms of a generalized linear model, I need a shifted exponential as residual distribution. The questions are:

1. Is a shifted exponential distribution in the exponential family?
2. If 1 is yes, how can I express it as an R glm() call? glm can use poisson, binomial, etc. as residual distributions. But no exponential is provided.
3. If 1 is no, what is the best way to fit this model? Should it be generalized nonlinear model (R package gnm) or something else?

---

I wrote a maximum likelihood fitter for the exponential residual, but it is slow and non-intuitive.

Answer 1

GLMs don't model additive errors, they model conditional distributions* -- for an exponential model you have $(Y|\mathbf{x})\sim \text{Exp}(g^{-1}(\mathbf{x}\beta))$ (here using the scale-parameterization of the exponential not the rate-parameterization).

The first model has constant variance, the second has variance that's a function of the mean.

The question you link to is asking about a conditionally exponential model (i.e. a GLM) not a shifted-exponential model (additive error model)

Is a shifted exponential distribution in the exponential family?

No.

how can I express it as an R glm() call? glm can use poisson, binomial, etc. as residual distributions. But no exponential is provided.

The exponential is a special case of the Gamma and is easily done in R ... but it's not shifted exponential

If 1 is no, what is the best way to fit this model? Should it be generalized nonlinear model (R package gnm) or something else?

gnm also assumes exponential family

I don't think MLE is difficult$^\dagger$; if you find the highest hyperplane that has no points below it, it should maximize the likelihood for the location parameters.

One way to find that is via quantile regression (such as the function rq in the package quantreg in R, by seting tau=0)

You can then get a sensible estimate of scale from the mean of the non-zero residuals from that fit (though the ML estimate would include the zero residuals, which is fine, though it will be biased of course). Adding that mean to the intercept from the quantile regression should give the intercept-estimate you were after.

For a pure ANOVA type model this could be overkill (in the sense of there being faster ways to identify parameters) but it seems to work quite nicely on what I tried it on.

---

* at least not in general; the subset of GLMs that are also LMs being the obvious exception

$^\dagger$ As long as you don't fall for trying to set derivatives to 0 ... just plugging this straight into some vanilla optimizer without a bit of thought first is not likely to work very well in general.