New answers tagged hyperparameter
1
From a certain point of view, optimizing the meta- or hyperparameter is the opposite approach to ensemble models. They are good for sifferent situations.
The point of ensemble models (stacked or bagged) is to reduce variance in the submodels due to the imperfect training (e.g. too few training cases). Bagging does not change the prediction and thus does not ...
answered Sep 14 at 17:25
cbeleites unhappy with SX
30.5k2 gold badges62 silver badges122 bronze badges
1
A potentially bigger problem than data leakage between test and training sets is the unreliability of test/train splits of small data sets. You need many thousands of cases for that to be reliable. Otherwise you are throwing away information by limiting the size of the training set, and you are getting imprecise estimates of model validity by having too ...
Top 50 recent answers are included
