For example, you mentioned skewness and kurtosis - while those measures are certainly ways of identifying distributions that aren't Gaussian, and they can be combined into a single measure of deviation from Gaussian-ness* (and even form the basis of some common tests of normality), they're terriblenot great at identifying distributions that have the same skewness and kurtosis as a normal but are distinctly non-normal.
A measure based on skewness and kurtosis is going to be terriblefairly poor at identifying distributions such as these. Of course, if you're not worried about such possibilities, this may not matter - if you mainly want to pick up cases where the skewness and kurtosis deviate from those of the normal, a test based on those two measures is relatively powerful.