2
$\begingroup$

Hello I am struggling a bit understanding the random effects model.

What I understood is that we fit a model but allow for sysematic differences of the variance of residuals per group.

I would incorporate such different variances in the expected negative Gaussian log likelihood loss to be $-\log \mathcal{L} = \frac{1}{2} \sum_{i} \left( \log(\sigma_{j(i)}^2) + \frac{(y_{i} - \mu_{j(i)})^2}{\sigma_{j(i)}^2} \right)+C$ (*), where the variance depends on the group $j(i)$ of sample $i$. This will allow better fit of the resulting model: when the variance of a group is high, then its mean squared error terms will have "less weight" and the model can fit the remaining data points better.

Such a model would deal with "group wise heteroscdasticity".

I understand that people might also define a random effects model in terms of a generating random process $Y_i =\sum_k A_k X_{k,i} + \epsilon +\eta_{j(i)}$... But in my mind this boils down to (*) when assuming that $Y_i$ and the error terms $\epsilon$ and $\eta_{j(i)}$ follow normal distributions and then doing maximum likelihood estimation...

Since I cannot find any literatur which uses the word heteroscdasticity and random effects model together, I guess my understanding/intuition is wrong. Could you please guide me to the essential logic piece behind random effects models?

$\endgroup$
4
  • $\begingroup$ What you seem to have in mind sounds a lot like a hierarchical model. $\endgroup$
    – Durden
    Commented Jan 14 at 15:16
  • $\begingroup$ or look for "location-scale" models $\endgroup$
    – Ben Bolker
    Commented Jan 14 at 15:32
  • 1
    $\begingroup$ I would look at this youtube.com/… and see if this makes sense. But I am interested in following up on your approach as well. $\endgroup$
    – manav
    Commented Jan 14 at 15:33
  • $\begingroup$ @manav thank you a lot for these great videos. I see that I was mainly missing the special time series/ panel character of the models which are essential to understand the models $\endgroup$
    – Ggjj11
    Commented Jan 14 at 20:49

0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Browse other questions tagged or ask your own question.