Number of bootstrap samples to construct confidence interval in mixed models [duplicate]

Question

library(lme4)
library(merTools)
data(sleepstudy)
fm1 <- lmer(Reaction ~ Days + (Days|Subject), data=sleepstudy)
PI <- predictInterval(merMod = fm1, newdata = sleepstudy,
                  level = 0.95, n.sims = 1000,
                  stat = "median", type="linear.prediction",
                  include.resid.var = TRUE)

My question is: is there a rule of thumb of what the value of n.sims should be?

EDIT

My data contains 20686 rows (i.e. 20686 response variables) and 20 predictors. For such dataset, how many bootstrap samples are required? Is there any plots or papers that I can refer to that explain the number of bootstrap samples as a function of data size?

Answer 1

In addition to what can be found in the linked answer, some pointers:

• More is better. Bootstrapping takes random subsamples with replacement, so the more often you do this, the smaller the chance your results are affected by the stochastic nature of this approach. For your final model you should do whatever number of bootstrap samples $B$ is still computationally feasible.

• If your data set is very large, or your model very complex, then $B=1,000$ may be prohibitively large for simple trial and error, so you could start with a lower number, bearing in mind that the variance will be larger.

For example, if $B=1,000$ takes 10 minutes to run on your system, then simply halving to $B=500$ will already allow you to do twice as much trial and error in the same time. Your final comparisons could then be run overnight with a much larger number (e.g. $B=10,000$).