1
$\begingroup$

Here's the guide I'm looking at: http://blog.kaggle.com/2016/12/27/a-kagglers-guide-to-model-stacking-in-practice/

Here's the relevant excerpt: The main point to take home is that we’re using the predictions of the base models as features (i.e. meta features) for the stacked model. So, the stacked model is able to discern where each model performs well and where each model performs poorly. It’s also important to note that the meta features in row $i$ of train_meta are not dependent on the target value in row $i$ because they were produced using information that excluded the target_i in the base models’ fitting procedure.

Could somebody elaborate on why it is important that the meta features are not dependent on the corresponding label?

$\endgroup$
1
$\begingroup$

Different machine learning algorithms can have different degrees of overfitting on the training data. If you use meta features dependent on the target value, you will always favor the algorithm that is more overfitted. To avoid this favor, you should use data not dependent on the target value, i.e. cross-validation.

$\endgroup$
0
$\begingroup$

What the text mean is that the metafeatures are independent of test, since they were learned with train data, that is important because otherwise you would have information leak, and you will fooling yourself believing tour test score is good

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.