If my data follows a normal distribution I can standardize it for a machine learning algorithm, e.g. logistic regression, by subtracting the mean and dividing the result by the standard deviation.
But what should I do with data that is power law/Pareto distributed, e.g. words in a corpus? How should data in this case be standardized? Or should I prefer simple scale normalizatiom?
