5
$\begingroup$

I have model where coefficient is of different powers:

$$\mbox{log} ( \mu_{i} ) = \alpha + \beta x_1 + \beta^2x_2 + \beta^3x_3 + ... + \beta^nx_n \\ \\ N_{i} \sim \mbox{Poiss} ( \mu_{i} ) $$

$N_i$ and $x_i$ is the data, $\alpha$ and $\beta$ are model coefficients.

  1. Can this problem be somehow transformed so that it can be solved using GLM model? I.e. so that I can use the glm() function in R.
  2. If not, how can I solve this problem using some frequentist package in R? I can write model in WinBUGS but prefer to have "frequentist" solution in R, because it is much faster and inference is easier (one has p-values, t-tests, F-tests...). But which function or package use to fit it?

If you are interested how this problem was created: actually taking model from this question and adding coefficient $\beta$ for $\mbox{log} ( \mu_{i,j} )$ on the predictor side of the equation. While the transformation of the original model for use in GLM was elegant and without problem, adding $\beta$ coefficient complicated things and leads to the model presented here.

$\endgroup$
5
  • 1
    $\begingroup$ I added the nonlinear regression tag, since that what this is. Searching on that tag may find useful posts. $\endgroup$
    – Peter Flom
    Commented Jul 22, 2013 at 11:13
  • $\begingroup$ Thanks @Peter for this! I didn't even know what the name of the problem is. Now it will be much easier to search for help! $\endgroup$
    – Tomas
    Commented Jul 22, 2013 at 11:16
  • $\begingroup$ They are complex models.... But at least you know where to look $\endgroup$
    – Peter Flom
    Commented Jul 22, 2013 at 11:21
  • $\begingroup$ @Peter, the nonlinear models seem to be very general, allowing almost any predictor function. Isn't there something in between GLM and these nonlinear models, that would fit better to this problem? $\endgroup$
    – Tomas
    Commented Jul 22, 2013 at 14:30
  • $\begingroup$ Not that I know of. $\endgroup$
    – Peter Flom
    Commented Jul 22, 2013 at 14:36

1 Answer 1

2
$\begingroup$

This appears to be a generalized nonlinear model.

One could always use nonlinear least squares, and then iteratively reweight the observations according to their variance under the model (akin to using IRLS to estimate GLMs).

However, there are packages that can fit generalized nonlinear models in R.

For example, the gnm function in the gnm package seems to be a likely choice.

Another alternative would be to maximize the likelihood directly; there are only two parameters, and even more conveniently, conditional on the value of $\beta$, the likelihood of $\alpha$ can be readily maximized. As a result, this reduces it in effect to a univariate problem (for a given $\beta$, one can compute the ML estimate for $\alpha$ and evaluate the (log-)likelihood). The derivative is also computable, if need be, and there are several optimization functions in R.

$\endgroup$
1
  • $\begingroup$ +1 thanks Glen_b. I now have a similar problem, but with random effect: stats.stackexchange.com/questions/90702/… - would you know the answer? I've put 200 bounty on it. $\endgroup$
    – Tomas
    Commented Mar 26, 2014 at 20:10

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.