2
$\begingroup$

I was taught, that the arithmetic mean is sensitive to outliers and skewness. This was natural to me - the observations lying far from the "central point" of the distribution "pull" the measure towards them. Then I was advised to use the arithmetic mean only for symmetric distributions, ideally normal, but symmetry was found as "good enough". When it came to asymmetric distributions, left or right, I was told to use the median. In case of log-normal distributed data, which - as I was told - have multiplicative nature (whatever it means), I was advised to use the geometric mean, as better measure of the central tendency. But then I was told, that the arithmetic means is "valid for any distribution", as it is the BLUE (best linear unbiased) estimator of the population expected value (still - the arithmetic mean).

Now I'm lost. If the arithmetic mean is so good measure even for so strongly skewed distributions as the log-normal, then why telling about "robust measures", like geometric mean, winsorized mean, trimmed mean, mid-mean? According to what I was told, only the arithmetic mean is the BEST estimator. Moreover, the geometric mean is not an estimator of the population expected value, so why even bother with? Is this because the expected value, the first raw moment, not always is the best measure characterizing the central tendency? And that is because, even if the arithmetic mean is best estimator, we instead propose the geometric mean as the best measure of the central tendency instead (not expectance) instead?

In other words: is it that however every distribution (for which the first raw moment is deifned) has the expected value, which is the arithmetic mean, but the expected value is "useful" only for the normal (or symmetric) distribution, and for any other skewed ones we may prefer different measure of central tendency instead of the expectance (which plays important role in theoretical considerations anyway)?

Improve this question
$\endgroup$
7
  • 8
    $\begingroup$ useful for what purpose? moments are always useful for something $\endgroup$ – Aksakal Jan 31 '20 at 20:58
  • 5
    $\begingroup$ You might want to define "well" when you ask if it works well. $\endgroup$ – Jeremy Miles Jan 31 '20 at 20:59
  • 1
    $\begingroup$ The sample mean is a good estimator of the true mean (if it exists) but the true mean is not always a good measure of central tendency. $\endgroup$ – Michael M Jan 31 '20 at 21:31
  • $\begingroup$ Thank you, Michael M.! That is it! So the dozens of central tendency measures (Wikipedia lists more than ten of them, including the Winsorized mean) are invented to better describe the "typical observations". For symmetric distributions, including the normal one, the central tendency also coincides with the arithmetic mean, the first raw moment, right? $\endgroup$ – Goala Jan 31 '20 at 21:56
  • 1
    $\begingroup$ 1. The sample mean can be an excellent estimator of the population mean when the distribution is moderately skew (consider the exponential, for example; it's maximum likelihood in that case). 2. One thing I tend to find when people try things with the lognormal is that they restrict attention to quite "nice" cases. You might look at how things go when the skewness is actually high - like say $\sigma=4$. $\endgroup$ – Glen_b Feb 1 '20 at 6:16
1
$\begingroup$

Whether the arithmetic mean is a good measure for a strongly skewed distribution depends on what you are using it for -- what does "good" mean?

One variable that is usually very right skew is income and, usually, you see median income rather than mean income. But why?

Because, usually, when we look at some measure of central tendency, we are looking for something like a "typical" value. So if we wanted to compare incomes in different countries, it would be natural to compare medians (or maybe other quantiles) rather than arithmetic means, because it is closer to what we are interested in. On the other hand, if we were interested in the total capital available in different countries, the arithmetic mean would be better.

Sometimes, though, the arithmetic mean makes very little sense. If we are trying to average numbers on different scales then the arithmetic mean is still BLUE, but it's a BLUE of a number that isn't useful. For instance, suppose you are averaging students' SAT scores (0 to 1600) and their high school grades (0 to 4). Then you won't want the arithmetic mean. Here you want the geometric mean.

Or, if you are averaging rates that have different denominators, the arithmetic mean will again be BLUE, but of a number that isn't useful. For instance, if you make a trip of 300 km at 100 kph and return at 150 kph, then the arithmetic mean is 125 kph, but this is not very useful because you took 5 hours to go 600 km, which is 120 kph. Here you probably want the harmonic mean.

For more details on this, see my blog post the geometric and harmonic means.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.