I am doing feature engineering on a set of features to reduce the size of the dataset. The features can have different scales. E.g, one feature has values that vary between 1000 and 1500, and the other features vary between 0 and 100. One of the tests that I do in feature engineering is to remove one feature that has high correlation with another.
I have tried to scale the data before doing the feature engineering, and also the opposite. In the first use case, I obtain 60 features, and on the latter use case, I obtain 54 features.
Which is the correct way to do it? Should we do feature engineering before or after scaling?