Questions tagged [reml]

Restricted maximum likelihood (reml) is a variant of maximum likelihood when estimation is based on some transformations of the data, typically to residuals.

Filter by
Sorted by
Tagged with
5
votes
1answer
43 views

How are PQL, REML, ML, Laplace, Gauss-Hermite related to each other?

While learning about the Generalized Linear Mixed Models, I often see the above terms. Sometimes it seems to me these are separate methods of estimation of (fixed? random? both?) effects, but when I ...
2
votes
1answer
35 views

Why does the glmmTMB gives different fixed effects when random slopes are requested vs just intercepts?

I am trying to fit a beta regression to my data using mixed models, as there are 4 repeated observations per subject. Legend: p = (time) point: t1...t4 ID = subject ID When I try: ...
2
votes
0answers
64 views

Model selection with different fixed effects and different corARMA structures

I analyzed the effect of temperature (4 different areas) on laying date: LDT ~ Aa3+Bb+Cc+Dd. Because of autocorrelation in residuals I used ...
12
votes
1answer
189 views

Does a Bayesian interpretation exist for REML?

Is a Bayesian interpretation of REML available? To my intuition, REML bears a strong likeness to so-called empirical Bayes estimation procedures, and I wonder if some kind of asymptotic equivalence (...
0
votes
1answer
83 views

Does “random effect” really exist in real data when we use random/mixed effect model? [closed]

If I understand correctly, here is a standard case when we need the mixed effect model: We are interested in studying the how drugs influence human health conditions, so we collected information ...
2
votes
1answer
629 views

Why are the coefficients of REML and ML estimation the same? What does that mean?

I have estimated a linear mixed model with REML and ML estimation. However, the estimated coefficients do not differ. The standard errors of the coefficients are slightly higher for the REML ...
0
votes
1answer
50 views

tau2 estimation using reml in SAS

I would like to obtain tau2 estimation using REML by making use of PROC MIXED procedure in SAS to compare the estimation result obtained from rma function in R. I have used the following SAS code; ...
3
votes
0answers
42 views

Are REML estimators of variance-covariance parameters consistent?

I am trying to locate some reference papers about consistency of REML estimators in linear mixed effects models. My understanding is that in linear model scenario, REML will produce the exact same ...
1
vote
1answer
616 views

Deriving the maximum likelihood of REML for linear mixed model

Consider the linear model $Y = X \beta + e$, $e \sim N(0, V(\theta))$, where $Y$ is a $n \times 1$ vector, $X$ is the $n \times p$ full rank design matrix, $V(\theta)$ is the covariance matrix. I drop ...
0
votes
1answer
70 views

Mixed-model in R - Am I doing this right? Why is it always significant?

Here is my experiment: I evaluated the same individuals before applying treatment1, treatment2, a combination of both or none of ...
0
votes
0answers
136 views

Using ML or REML when comparing factor levels with Wald test?

I have finished my model reduction of a linear mixed model (and have used ML for this) and have found which factors that are significant in my final model. I am aware of that using ML is necessary ...
0
votes
0answers
538 views

“Time” as continuous, ordinal, or nominal in this REML design?

I've assayed two treatment groups at three time points. The time points are "days post inoculation" (specifically, 0, 20 and 40 days), so the interval between the measure is meaningful. I've ...
1
vote
1answer
215 views

meta-analysis in R REML estimator

Does the REML estimator (default) in the R metafor package provides inverse-variance weighting?
1
vote
1answer
3k views

How to obtain REML estimates in a glmer? Optimizing random effects structure in glmer function (lme4 R package)

I'm trying to fit a model with the function glmer (lmer4 1.1-7 package) in R using REML. I tried to use the argument method=REML to do it, but this argument is deprecated. It seems that the way to ...
1
vote
1answer
70 views

Why does $y \text{~} N(X \beta, \sigma^2 V)$ $\implies$ $M^T y \text{~} N(0, \sigma^2 M^T V M)$

Why does $$y \text{~} N(X \beta, \sigma^2 V)$$ $\implies$ $$M^T y \text{~} N(0, \sigma^2 M^T V M)$$? When $M^T X=0$ and $M^T M = I$.
1
vote
2answers
491 views

Kenward-Roger and REML

I am doing some mixed model analyses using the lmer function in R's lme4 package. I am using the ...
2
votes
1answer
155 views

How does case-resampling bootstrap work for positive-value estimators?

I've looked at some other questions on bootstrap significance testing: Non-parametric bootstrap p-values vs confidence intervals Computing p-value using bootstrap with R p-value vs. confidence ...
0
votes
0answers
431 views

Big Misconception in the use of REML to estimate Variance Components?

I often hear from my classmates, and even in resources on the internet such as in the abstract to this paper, what I now believe to be a misconception regarding the motivation of using REML (...
1
vote
0answers
238 views

What is the difference between Restricted Maximum Likelihood (REML) and Maximum Likelihood (ML)? [duplicate]

I am a first year graduate student in biostatistics, and I have somewhat of an idea of the difference between REML and ML. However, I want a more in-depth understanding of each estimation method, ...
5
votes
1answer
297 views

How are calculations done for REML?

I've read a few questions on this site (e.g., https://stats.stackexchange.com/a/48676/46427), but they rarely go beyond intuitive explanations. I am particularly interested with how to calculate an ...
14
votes
1answer
405 views

Restricted maximum likelihood with less than full column rank of $X$

This question deals with restricted maximum likelihood (REML) estimation in a particular version of the linear model, namely: $$ Y = X(\alpha)\beta + \epsilon, \\ \epsilon\sim N_n(0, \Sigma(\alpha)),...
4
votes
1answer
818 views

How to use REML to estimate correlation with missing data in R?

In JMP Multivariate Methods, REML is used to estimate correlation when there are missing data values (pg. 28). However, there is no documentation describing how this is done. I'm trying to compare ...
1
vote
0answers
132 views

Restricted Maximum Likelihood Estimation for Linear Mixed Model

The maximum likelihood estimation procedure for linear mixed model is described in this link. It seems to me that something is wrong there. In their Restricted Maximum Likelihood section the first ...
4
votes
1answer
306 views

Which iterative algorithm lmer uses for REML estimation?

For mixed model, when we estimate variance component by restricted maximum likelihood estimation procedure, an iterative algorithm is required to solve the estimating equations for variance component. ...
0
votes
0answers
117 views

Restricted Maximum Likelihood Estimates of Multilevel Regression Model

A two-level regression model : $$Y_{ij} = \gamma_{00} + \gamma_{10}X_{ij} + \gamma_{01}Z_j + \gamma_{11}X_{ij}Z_j + u_{0j} + u_{1j}X_{ij} + e_{ij}$$ where $e_{ij}\sim N(0,\sigma^2_e)$ and , $$ \...
7
votes
1answer
797 views

Citation for ML vs. REML

Quick question: can anyone give me a citation that I can use to justify using ML when doing model comparisons? Background: I am fitting some multilevel models in R using lme4, and I do a series of ...
1
vote
0answers
199 views

Mixed Linear Model - REML approach AI or FS algorithm

I am trying to see if there is a situation where Fisher scoring algorithm would be better than Average Information algorithm. I know that Average information algorithm is more efficient for large data ...
11
votes
2answers
889 views

Why does Restricted maximum likelihood yield a better (unbiased) estimate of the variance?

I'm reading Doug Bates' theory paper on R's lme4 package to better understand the nitty-gritty of mixed models, and came across an intriguing result that I'd like to understand better, about using ...
3
votes
1answer
323 views

Restricted Maximum Likelihood

Why don't we use restricted maximum likelihood to estimate parameters in non-mixed models?
2
votes
0answers
63 views

REML estimation - matrix algebra internals

In the context of REML estimation there is the result (ignoring some constants) that (my interest is in the matrix algebra so some notation is suppressed): $l(\mathbf V_0)=\log |\mathbf V_0| + \text{...
14
votes
3answers
3k views

Why does one have to use REML (instead of ML) for choosing among nested var-covar models?

Various descriptions on model selection on random effects of Linear Mixed Models instruct to use REML. I know difference between REML and ML at some level, but I don't understand why REML should be ...
73
votes
3answers
63k views

What is “restricted maximum likelihood” and when should it be used?

I have read in the abstract of this paper that: "The maximum likelihood (ML) procedure of Hartley aud Rao is modified by adapting a transformation from Patterson and Thompson which partitions the ...