I'm curious if it's useful to collapse numerical dimensions by simply adding them together. For example, I have a data set that has two tightly correlated values. I'd like to trim down the number of dimensions I have so that my ML algorithm has less noise to work with.
Wouldn't it be simple enough to add these two tightly correlated values together and treat them as one dimension?