Skip to main content
replaced http://stats.stackexchange.com/ with https://stats.stackexchange.com/
Source Link

First of all, you have different models you want to compare! In m2 you drop the intercept and this is generally a bad ideagenerally a bad idea. If you use mixed model you have a random sample of groups, while in the case of linear regression you are interested in estimating the fixed effects of certain groups (or, you could say, the differences between groups) - so those are totally different models with different data structure assumed.

Using AIC and likelihood ratio tests should be used "with caution" for mixed models. Also in your code you have REML=TRUE (the default), so AIC of this model is based on restricted likelihood, while for the linear model based on likelihood. If you want to compare different mixed models based on likelihood-based measures you should switch to REML=FALSE (see herehere or herehere).

Why you assume small sample sizes to make the data more suitable for a mixed model? Generally, small sample sizes for groups are also not goodsmall sample sizes for groups are also not good for mixed models.

Another thing: you want to compare standard errors for linear regression vs. standard errors for random effects in linear mixed model - those are two different things. You compare errors for the whole model vs. errors for just a part of model. You write about comparing accuracy of predictions, but random effect estimates are rather predictions, not estimatesare rather predictions, not estimates. You use random effects when you have a random sample from the population and you care about the population effects, rather then individuals (like with linear regression you care about precise estimate on average rather then estimate that fits for every observation).

So no, this approach is generally not correct. Linear regression and linear mixed models are different models with different assumptions. You should choose one of those based on what is your data and what do you want to model. Read more on fixed and random effectsfixed and random effects to get a better feeling of the differences. Check also this book:

Gelman, A. & Hill, J. (2006). Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge University Press.

it gives a nice introduction to linear mixed models (and using lme4). You'll find there also a comparison between linear regression and mixed models.

First of all, you have different models you want to compare! In m2 you drop the intercept and this is generally a bad idea. If you use mixed model you have a random sample of groups, while in the case of linear regression you are interested in estimating the fixed effects of certain groups (or, you could say, the differences between groups) - so those are totally different models with different data structure assumed.

Using AIC and likelihood ratio tests should be used "with caution" for mixed models. Also in your code you have REML=TRUE (the default), so AIC of this model is based on restricted likelihood, while for the linear model based on likelihood. If you want to compare different mixed models based on likelihood-based measures you should switch to REML=FALSE (see here or here).

Why you assume small sample sizes to make the data more suitable for a mixed model? Generally, small sample sizes for groups are also not good for mixed models.

Another thing: you want to compare standard errors for linear regression vs. standard errors for random effects in linear mixed model - those are two different things. You compare errors for the whole model vs. errors for just a part of model. You write about comparing accuracy of predictions, but random effect estimates are rather predictions, not estimates. You use random effects when you have a random sample from the population and you care about the population effects, rather then individuals (like with linear regression you care about precise estimate on average rather then estimate that fits for every observation).

So no, this approach is generally not correct. Linear regression and linear mixed models are different models with different assumptions. You should choose one of those based on what is your data and what do you want to model. Read more on fixed and random effects to get a better feeling of the differences. Check also this book:

Gelman, A. & Hill, J. (2006). Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge University Press.

it gives a nice introduction to linear mixed models (and using lme4). You'll find there also a comparison between linear regression and mixed models.

First of all, you have different models you want to compare! In m2 you drop the intercept and this is generally a bad idea. If you use mixed model you have a random sample of groups, while in the case of linear regression you are interested in estimating the fixed effects of certain groups (or, you could say, the differences between groups) - so those are totally different models with different data structure assumed.

Using AIC and likelihood ratio tests should be used "with caution" for mixed models. Also in your code you have REML=TRUE (the default), so AIC of this model is based on restricted likelihood, while for the linear model based on likelihood. If you want to compare different mixed models based on likelihood-based measures you should switch to REML=FALSE (see here or here).

Why you assume small sample sizes to make the data more suitable for a mixed model? Generally, small sample sizes for groups are also not good for mixed models.

Another thing: you want to compare standard errors for linear regression vs. standard errors for random effects in linear mixed model - those are two different things. You compare errors for the whole model vs. errors for just a part of model. You write about comparing accuracy of predictions, but random effect estimates are rather predictions, not estimates. You use random effects when you have a random sample from the population and you care about the population effects, rather then individuals (like with linear regression you care about precise estimate on average rather then estimate that fits for every observation).

So no, this approach is generally not correct. Linear regression and linear mixed models are different models with different assumptions. You should choose one of those based on what is your data and what do you want to model. Read more on fixed and random effects to get a better feeling of the differences. Check also this book:

Gelman, A. & Hill, J. (2006). Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge University Press.

it gives a nice introduction to linear mixed models (and using lme4). You'll find there also a comparison between linear regression and mixed models.

added 14 characters in body
Source Link
Tim
  • 141.2k
  • 26
  • 270
  • 512

First of all, you have different models you want to compare! In m2 you drop the intercept and this is generally a bad idea. If you use mixed model you have a random sample of groups, while in the case of linear regression you are interested in estimating the fixed effects of certain groups (or, you could say, the differences between groups) - so those are totally different models with different data structure assumed.

Using AIC and likelihood ratio tests should be used "with caution" for mixed models. Also in your code you have REML=TRUE (the default), so AIC of this model is based on restricted likelihood, while for the linear model based on likelihood. If you want to compare different mixed models based on likelihood-based measures you should switch to REML=FALSE (see here or here).

Why you assume small sample sizes to make the data more suitable for a mixed model? Generally, small sample sizes for groups are also not good for mixed models.

Another thing: you want to compare standard errors for linear regression vs. standard errors for random effects in linear mixed model - those are two different things. You compare errors for the whole model vs. errors for just a part of model. You write about comparing accuracy of predictions, but random effect estimates are rather predictions, not estimates. You use random effects when you have a random sample from the population and you care about the population effects, rather then individuals (like with linear regression you care about precise estimate on average rather then estimate that fits for every observation).

So no, this approach is generally not correct. Linear regression and linear mixed models are different models with different assumptions. You should choose one of those based on what is your data and what do you want to model. Read more on fixed and random effects to get a better feeling of the differences. Check also this book:

Gelman, A. & Hill, J. (2006). Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge University Press.

it gives a nice introduction to linear mixed models (and using lme4). You'll find there also a comparison between linear regression and mixed models.

First of all, you have different models you want to compare! In m2 you drop the intercept and this is generally a bad idea. If you use mixed model you have a random sample of groups, while in the case of linear regression you are interested in estimating the effects of groups (or, you could say, the differences between groups) - so those are totally different models with different data structure assumed.

Using AIC and likelihood ratio tests should be used "with caution" for mixed models. Also in your code you have REML=TRUE (the default), so AIC of this model is based on restricted likelihood, while for the linear model based on likelihood. If you want to compare different mixed models based on likelihood-based measures you should switch to REML=FALSE (see here or here).

Why you assume small sample sizes to make the data more suitable for a mixed model? Generally, small sample sizes for groups are also not good for mixed models.

Another thing: you want to compare standard errors for linear regression vs. standard errors for random effects in linear mixed model - those are two different things. You compare errors for the whole model vs. errors for just a part of model. You write about comparing accuracy of predictions, but random effect estimates are rather predictions, not estimates. You use random effects when you have a random sample from the population and you care about the population effects, rather then individuals (like with linear regression you care about precise estimate on average rather then estimate that fits for every observation).

So no, this approach is generally not correct. Linear regression and linear mixed models are different models with different assumptions. You should choose one of those based on what is your data and what do you want to model. Read more on fixed and random effects to get a better feeling of the differences. Check also this book:

Gelman, A. & Hill, J. (2006). Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge University Press.

it gives a nice introduction to linear mixed models (and using lme4). You'll find there also a comparison between linear regression and mixed models.

First of all, you have different models you want to compare! In m2 you drop the intercept and this is generally a bad idea. If you use mixed model you have a random sample of groups, while in the case of linear regression you are interested in estimating the fixed effects of certain groups (or, you could say, the differences between groups) - so those are totally different models with different data structure assumed.

Using AIC and likelihood ratio tests should be used "with caution" for mixed models. Also in your code you have REML=TRUE (the default), so AIC of this model is based on restricted likelihood, while for the linear model based on likelihood. If you want to compare different mixed models based on likelihood-based measures you should switch to REML=FALSE (see here or here).

Why you assume small sample sizes to make the data more suitable for a mixed model? Generally, small sample sizes for groups are also not good for mixed models.

Another thing: you want to compare standard errors for linear regression vs. standard errors for random effects in linear mixed model - those are two different things. You compare errors for the whole model vs. errors for just a part of model. You write about comparing accuracy of predictions, but random effect estimates are rather predictions, not estimates. You use random effects when you have a random sample from the population and you care about the population effects, rather then individuals (like with linear regression you care about precise estimate on average rather then estimate that fits for every observation).

So no, this approach is generally not correct. Linear regression and linear mixed models are different models with different assumptions. You should choose one of those based on what is your data and what do you want to model. Read more on fixed and random effects to get a better feeling of the differences. Check also this book:

Gelman, A. & Hill, J. (2006). Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge University Press.

it gives a nice introduction to linear mixed models (and using lme4). You'll find there also a comparison between linear regression and mixed models.

Source Link
Tim
  • 141.2k
  • 26
  • 270
  • 512

First of all, you have different models you want to compare! In m2 you drop the intercept and this is generally a bad idea. If you use mixed model you have a random sample of groups, while in the case of linear regression you are interested in estimating the effects of groups (or, you could say, the differences between groups) - so those are totally different models with different data structure assumed.

Using AIC and likelihood ratio tests should be used "with caution" for mixed models. Also in your code you have REML=TRUE (the default), so AIC of this model is based on restricted likelihood, while for the linear model based on likelihood. If you want to compare different mixed models based on likelihood-based measures you should switch to REML=FALSE (see here or here).

Why you assume small sample sizes to make the data more suitable for a mixed model? Generally, small sample sizes for groups are also not good for mixed models.

Another thing: you want to compare standard errors for linear regression vs. standard errors for random effects in linear mixed model - those are two different things. You compare errors for the whole model vs. errors for just a part of model. You write about comparing accuracy of predictions, but random effect estimates are rather predictions, not estimates. You use random effects when you have a random sample from the population and you care about the population effects, rather then individuals (like with linear regression you care about precise estimate on average rather then estimate that fits for every observation).

So no, this approach is generally not correct. Linear regression and linear mixed models are different models with different assumptions. You should choose one of those based on what is your data and what do you want to model. Read more on fixed and random effects to get a better feeling of the differences. Check also this book:

Gelman, A. & Hill, J. (2006). Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge University Press.

it gives a nice introduction to linear mixed models (and using lme4). You'll find there also a comparison between linear regression and mixed models.