It is a known fact that median is resistant to outliers. If that is the case, when and why would we use the mean in the first place?
One thing I can think of perhaps is to understand the presence of outliers i.e. if the median is far from the mean, then the distribution is skewed and perhaps the data needs to be examined to decide what is to be done with the outliers. Are there any other uses?
In a sense, the mean is used because it is sensitive to the data. If the distribution happens to be symmetric and the tails are about like the normal distribution, the mean is a very efficient summary of central tendency. The median, while being robust and well-defined for any continuous distribution, is only $\frac{2}{\pi}$ as efficient as the mean if the data happened to come from a normal distribution. It is this relative inefficiency of the median that keeps us from using it even more than we do. The relative inefficiency translates into a minor absolute inefficiency as the sample size gets large, so for large $n$ we can be more guilt-free about using the median.
It is interesting to note that for a measure of variation (spread, dispersion), there is a very robust estimator that is 0.98 as efficient as the standard deviation, namely Gini's mean difference. This is the mean absolute difference between any two observations. [You have to multiply the sample standard deviation by a constant to estimate the same quantity estimated by Gini's mean difference.] An efficient measure of central tendency is the Hodges-Lehmann estimator, i.e., the median of all pairwise means. We would use it more if its interpretation were simpler.
w <- outer(x, x, '+'); median(w[row(w) >= col(w)])/2. A trivial C, Fortran, or Ratfor program could be called by R to make it blazing fast. The ICSNP package in R has a fairly efficient implementation with its hl.loc function. For N=5000 it was 2.66 times faster than the above code (total time 1.5 sec.). It would be nice to also get an confidence interval efficiently.
$\endgroup$
Commented
Aug 13, 2011 at 17:29
Lots of great answers already, but, taking a step back and getting a little more basic, I'd say it's because the answer you get depends on the question you ask. The mean and median answer different questions - sometimes one is appropriate, sometimes the other.
It's simple to say that the median should be used when there are outliers, or for skewed distributions, or whatever. But that's not always the case. Take income - nearly always reported with median, and usually that's right. But if you are looking at the spending power of a whole community, it may not be right. And in some cases, even the mode might be best (esp. if the data are grouped).
When a value is garbage for us we call it "outlier" and want analysis be robust to it (and prefer median); when that same value is attractive we call it "extreme" and want analysis be sensitive to it (and prefer mean). Dialectics ...
Mean reacts equally to a shift of value irrespective to where in the distribution the shift takes place. For example, in 1 2 3 4 5 you may increase any value by 2 - the increase of mean will be the same. Median's reaction is less "consistent": add 2 to data points 4 or 5, and median won't increase; but add 2 to point 2 - so that the shift is over the median, and the median changes dramatically (greatly than mean will change).
Mean is always exactly located. Median is not; for example, in set 1 2 3 4 any value between 2 and 3 can be called median. Thus, analyses based on medians are not always unique solution.
Mean is a locus of minimal sum-of-squared-deviations. Many optimization tasks based on linear algebra (including famous OLS regression) minimize this squared error and therefore imply concept of mean. Median a locus of minimal sum-of-absolute-deviations. Optimization techniques to minimize such error are non-linear and are more complex / poorly known.
There are a lot of answers to this question. Here's one that you probably won't see elsewhere so I'm including it here because I believe it's pertinent to the topic. People often believe that because the median is considered a robust measure with respect to outliers that it's also robust to most everything. In fact, it's also considered robust to bias in skewed distributions. These two robust properties of the median are often taught together. One might note that underlying skewed distributions also tend to generate small samples that look like they have outliers and conventional wisdom is that one use medians in such situations.
#function to generate random values from a skewed distribution
rexg <- function (n, m, sig, tau) {
rexp(n, rate = 1/tau) + rnorm(n, mean = m, sd = sig)
}
(just a demonstration that this is skewed and the basic shape)
hist(rexg(1e4, 0, 1, 1))
Now, let's see what happens if we sample from this distribution various sample sizes and calculate median and mean to see what the differences between them are.
#generate values with various n's
N <- 1e4
ns <- 2:30
y <- sapply(ns, function(x) mean(apply(matrix(rexg(x*N, 0, 1, 1),
ncol = N), 2, median)))
plot(ns,y, type = 'l', ylim = c(0.85, 1.03), col = 'red')
y <- sapply(ns, function(x) mean(colMeans(matrix(rexg(x*N, 0, 1,
1), ncol = N))))
lines(ns,y)
As can be seen from the above plot the median (in red) is much more sensitive to the n than the mean. This is contrary to some conventional wisdom regarding using medians with low ns, especially if the distribution might be skewed. And, it reinforces the point that the mean is a known value while the median is sensitive to other properties, one if which being the n.
This analysis is similar to Miller, J. (1988). A warning about median reaction time. Journal of Experimental Psychology: Human Perception and Performance, 14(3):539–543.
REVISION
Upon thinking about the skew issue I considered that the impact on the median might just be because in small samples you have a greater probability that the median is in the tail of the distribution, whereas the mean will almost always be weighted by values closer to the mode. Therefore, perhaps if one was just sampling with a probability of outliers then maybe the same results would occur.
So I thought about situations where outliers may occur and experimenters may attempt to eliminate them.
If outliers happened consistently, such as one in every single sampling of data, then medians are robust against the effect of this outlier and the conventional story about the use of medians holds.
But that's not usually how things go.
One might find an outlier in very few cells of an experiment and decide to use median instead of mean in this case. Again, the median is more robust but it's actual impact is relatively small because there are very few outliers. This would definitely be a more common case then the one above but the effect of using a median would probably be so small that it wouldn't matter much.
Perhaps more commonly outliers might be a random component of the data. For example, the true mean and standard deviation of the population may be about 0 but there's a percentage of the time we sample from an outlier population where the mean is 3. Consider the following simulation, where just such a population is sampled varying the sample size.
# generate n samples N times with an outp probability
# of an outlier.
rout <- function (n, N, outp) {
outPos <- sample(0:1,n*N, replace = TRUE,
prob = c(1-outp, outp))
numOutliers <- sum(outPos)
y <- matrix( rnorm(N*n), ncol = N )
y[which(outPos==1)] <- rnorm(numOutliers, 4)
return(y)
}
outp <- 0.1
N <- 1e4
ns <- 3:30
yMed <- sapply(ns, function(x) mean(apply(rout(x,N,outp), 2,
median)))
var(yMed)
yM <- sapply(ns, function(x) mean(colMeans(rout(x, N, outp))))
var(yM)
plot(ns,yMed, type = 'l', ylim = range(c(yMed,yM)), ylab = 'Y',
xlab = 'n', col = 'red')
lines(ns,yM)
The median is in red and mean in black. This is a similar finding to that of a skewed distribution.
In a relatively practical example of the use of medians to avoid the effects of outliers one can come up with situations where the estimate is affected by n much more when the median is used than when the mean is used.
From the mean it's easy to calculate the sum over all items, e.g. if you know the average income of the population and the size of the population, you can immediately calculate the total income of the entire population.
The mean is straightforward to calculate in O(n) time complexity. Calculating the median in linear time is possible but requires more thought. The obvious solution requiring sorting has worse (O(n log n)) time complexity.
And I speculate that there is another reason for the mean being more popular than the median:
"It is a known that median is resistant to outliers. If that is the case, when and why would we use the mean in the first place?"
In cases one knows there are no outliers, for example when one knows the data-generating process (for example in mathematical statistics).
One should point out the trivial, that, these two quantities (mean and median) are actually not measuring the same thing and that most users ask for the former when what they really ought to be interested in the latter (this point is well illustrated by the median-based Wilcoxon tests which are more readily interpreted than the t-tests).
Then, there are the cases where for some happenstance reason or another, some regulation imposes the use of the mean.
If the concern is over the presence of outliers, there are some straight-forward ways to check your data.
Outliers, almost by definition, come into our data when something changes either in the process generating the data or in the process collecting the data. i.e. the data ceases to be homogeneous. If your data is not homogeneous then neither the mean nor the median make much sense, since you are trying to estimate the central tendency of two separate data sets that have been mixed together.
The best method to ensure homogeneity is to examine the data-generating and -collection processes to ensure that all of your data is coming from a single set of processes. Nothing beats a little brain-power, here.
As a secondary check, you can turn to one of several statistical tests: chi-squared, Dixon's Q-test, Grubb's test or the control chart / process behavior chart (typically X-bar R or XmR). My experience is that, when your data can be ordered as it was collected, the process behavior charts are better at detecting outliers than the outlier tests. This use for the charts may be somewhat controversial, but I believe it is entirely consistent with Shewhart's original intent and it is a use that is explicitly advocated by Donald Wheeler. Whether you use the outliers tests or the process behavior charts, remember that a detected "outlier" is merely signalling potential non-homogeneity that needs to be further examined. It rarely makes sense to throw out data points if you don't have some explanation for why they were outliers.
If you are using R, the outliers package provides the outliers tests, and for process behavior charts there is the qcc, IQCC and qAnalyst. I have a personal preference for the usage and output of the qcc package.
When might you want the mean?
When forming a diversified portfolio, deciding what to invest in and how much, the mean and covariance of returns are likely to factor prominently into your optimization problem.
We use the mean more than the median because it is additive, in two senses. (I am surprised that in 11 years, no one has really said this!)
If data on a population is broken down into data about men and data about women, then for example: \begin{align} \text{average overall height =} &\text{average height for men} * \text{fraction of men}\\ & + \text{average height of women} * \text{fraction of women} \end{align} So means are additive over merged populations: the mean of a large population is the average of means over subpopulations, weighted by their sizes. No analog holds for medians.
If we have data on paired variables for a single population, then for example: \begin{align} \text{average income after tax =} &\text{ average income before tax}\\ & - \text{average taxes paid} \end{align} So means are additive over paired variables; the mean of a sum or difference is the sum or difference of the means. No analog holds for medians.
If we have data broken down by day of the week, then for example: \begin{align} \text{average sales for a week = } &\text{average sales for a Sunday} + \\ &\cdots + \text{average sales for a Saturday} \end{align} This could be considered an example of either of the above situations. Again, no analog holds for medians.
Because means are additive, you can calculate a mean from smaller pieces of data. But to calculate a median usually requires having one comprehensive data source for everything. This is a much bigger practical issue than a little loss of efficiency in a summary statistic.
The geometric mean also has these same properties, with addition replaced by multiplication, additive replaced by multiplicative, etc.
In general, the only statistics with both of these aggregative properties are transformed versions of the mean, of the form $f^{-1}(E[f(X)])$, for some increasing function $f$. E.g., the geometric mean is the case with $f(x)=\ln(x)$, $f^{-1}(x)=e^x$. The general result can be seen as a corollary of the Morgenstern-von Neumann theorem on expected utility.
