What's special about moments that allows "method of moments" to work?

The idea behind Method of Moments (MOM) is quite intuitive:

find the parameter values so that the population moments (which are functions of those parameters of interest) matches the sample moments.

But why moments? My hunch is that moments are used because they capture the essence of the DGP. (More formalization of this hunch would be appreciated!) This begs the question: is there "something else" that can capture the essence of the DGP? In other words, can we

find the parameter values so that the population "something else" (which are functions of those parameters of interest) matches the sample "something else"?

Is it correct to think that the likelihood is one such "something else", thus motivating MLE? Or could quantile be one such "something else", thus motivating a "method of quantiles"?

• A likelihood is not a population property. It's unclear what you could mean by "essence of the DGP," given that a moment of any monotonic transformation of the data values also works in MoM. Perhaps what makes working with moments attractive and generalizable is that they are all averages.
– whuber
Jun 28 at 22:13
• Method of Moments are particularly attractive to those who like unbiased estimators. But it can in some particular cases lead to absurd results. Jun 28 at 22:48
• @whuber By "essence of the DGP", I mean the something like the "ways to sufficiently characterize the distribution of the data". Moments can be one such way (understanding that moments don't completely characterize the distribution). Is there any other way? For example, can we have a "method of quantiles"? Jun 29 at 7:01
• One way to view moments is that they are coefficients of a Hilbert basis. Choose another basis and you get a different set of coefficients. Fourier analysis can be understood in this way, for instance. But guessing what might work is not a fruitful avenue of investigation. Instead, study the conceptual and theoretical bases of statistical inference and decision theory to find ways to develop and evaluate methods of inference.
– whuber
Jun 30 at 13:47

Yes, you can have a 'method of quantiles'. In a $$p$$-dimensional parametric family you can set $$p$$ observed quantiles equal to their expected values and (for most choices of the quantiles) get consistent estimators. For example, you can estimate the parameter in any location family using the median instead of the mean. Sometimes the mean will be more efficient (eg, Normal), sometimes the median will be more efficient (eg, Laplace). Similarly, you can estimate a scale parameter using differences in quantiles (eg, interquartile range).
Note that two RVs can have equal $$k$$-th moments for all $$k=1,2,...$$ and still be different, so they don't always capture "the essence" of the distribution. There are many counterexamples online but also in Casella and Berger.
However, ff the moment generating function is defined in an interval around $$0$$, then equality of moments provides equality of distributions.