Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

Bagging is the process of creating N learners on N different bootstrap samples, then taking the mean of their predictions.

My question is: Why not use any other type of sampling? Why use bootstrap samples?

share|improve this question

1 Answer 1

Interesting question. The bootstrap has good sampling properties, compared to some alternatives like the jackknife. The main downside of bootstrapping is that every iteration has to work with a sample that's as big as the original data set (which can be computationally expensive), while some other sampling techniques can work with much smaller samples.

This paper suggests that naïvely cutting the sample size can reduce performance, relative to bootstrap-based bagging, which would be a reason not to do so. The paper also introduces a novel method for using smaller samples in bagging estimates, while avoiding those problems.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.