# Is it appropriate to use bootstrapping to measure variance?

So, I always thought the idea of bootstrapping was that you have a sample from which you obtain an estimator for some function of the population (like the average height). And then when you bootstrap by resampling, you get draws from the distribution of the estimator (and hence the variance). I took it for granted that the mean across the bootstrapped samples would be the same as the mean from the original sample. This is definitely true for statistics such as any average across the population.

For any nonlinear function, however, such as the percentage of "rich people" in the sample, the two means will be different. So, bootstrapping is in effect telling you that your original estimator has a different mean now (which is in most cases also the mode).

Given this bias, is it still appropriate to use bootstrapping to measure variance (you obviously won't use the bootstrapped mean in place of the original estimate)?

## 1 Answer

Rather than representing problem in the bootstrap, this feature is sometimes used to estimate the bias in your original estimator, see for example chapter 10 of Bradley Efron and Robert Tibshirani (1993) "An Introduction to the Bootstrap". Chapman & Hall/CRC.

• Thanks Maarten. That makes a lot of sense. Here's a follow up question, though. Say I have two functions that I calculate based on a sample. One gives me low variance, but consistent bias (say 15%) while the other gives me more variance (say 1.5 times more), but almost no bias. Also, I have a choice of going with either one and then inferring the other based on it. Which one would you recommend I estimate directly from the sample? – ryu576 May 5 '13 at 1:20
• The answer to that question depends on how you value bias and precision, which in turn depends on things that only you as the researcher know. – Maarten Buis May 6 '13 at 7:52
• Fair enough, that makes sense. – ryu576 May 6 '13 at 21:08
• Here are some remarks on the trade-off between variance and bias: stata.com/statalist/archive/2013-05/msg00197.html – Maarten Buis May 7 '13 at 6:37