Bootstrapping linear function On my course of learning statistical methods, I have read about a boostrapping technique where to estimate some statistic $t$ on data $X$ we sample with replacement from the original data and obtain the estimates $t(X_1),\dots,t(X_n)$. For example, we can use $\bar t_n(X) := \frac1n\sum t(X_k)$ instead of $t(X)$. My question is: it seems that $\bar t_n(X) \to t(X)$ for linear statistic $t$, is that correct? Does it mean then that the bootstrapping technique is more useful to estimate some non-linear statistics?
 A: Bootstrap lets you to approximate the true distribution of your variable $X$, so that you can compute different statistics on bootstrap samples that approximate the true values. Here you can read an extended definition and introduction to bootstrap: Explaining to laypeople why bootstrapping works .
The general idea is that you sample with replacement $N$ cases out of $N$ cases in the dataset. You repeat this a number of times, say $R$, and so those bootstrap samples let you approximate the true, unknown, distribution of your variable. You can estimate any statistic on those samples, it does not have to be linear. Bootstrap lets you approximate the distribution of $X$, so you can use it with any statistic that can be estimated using your $X$ variable.
The power of this method is that it is simple and general and so can be used for a number of different methods. Bootstrap is also helpful because it can be used when there is no direct analytical solution, e.g. you want to estimate confidence intervals for data that comes from skewed distribution (e.g. here). On another hand, there are bootstrap solutions for problems that have analytical solutions, so they can be used as an alternative method (e.g. here). For more examples of using bootstrap check the book by Davidson and Hinkley "Bootstrap Methods and Their Applications" (more here).
A: Bootstrapping enables to approximate the "true" distribution of the statistic t (wikipedia).
By construction $\lim \limits_{n \to \infty} \bar{t}_n(X) = t(X)$. However, as said above, bootstrapping is normally not used for estimation of the statistic itself but for its distribution.
