8
$\begingroup$

For a random variable $X$, the skew is defined as $S(X):={\frac {E\overline{X}^3}{(E\overline{X}^2)^{3/2}}}$, where $\overline{X}=X-EX$. It is often claimed that positive (resp. negative) skew implies that the mean of $X$ is larger (resp. smaller) than the median of $X$.

However this implication can fail. For example, on a mixture of two Gaussians with appropriate chosen parameters (this can be checked directly). But it can even fail on unimodal distributions, for example the Weibull distribution (cf. Groeneveld, Skewness for the Weibull Family, 1986).

What additional conditions can we place on $X$ that will ensure $sign(Skew(X))=sign(mean(X)-median(X))$? Clearly there are trivial answers such as stipulating that $X$ belongs to a certain family of distributions, but I am wondering if there is any more general or nice condition.

$\endgroup$
10
  • 1
  • 2
    $\begingroup$ The comment by @stats has considerable force. No answer will be satisfactory, because you can change $X$ in arbitrarily tiny ways while effecting arbitrarily large and different changes in the skewness and mean. (Merely contaminate $X$ with a suitable atomic distribution.) Thus, trivial results can be asserted: e.g., people can reference families of distributions where this equivalent always holds, but that's of little or no interest because it's just a property of the family and not of random variables generally. $\endgroup$
    – whuber
    Commented Apr 1 at 18:33
  • 1
    $\begingroup$ My point is that it's unlikely you will find anything other than a direct restatement of the original condition. $\endgroup$
    – whuber
    Commented Apr 1 at 19:38
  • 1
    $\begingroup$ @whuber, why such pessimism? Eg: A nice condition for mean>median in the exponential family of distributions would seem both plausible and of interest. $\endgroup$
    – user225256
    Commented Apr 3 at 14:06
  • 3
    $\begingroup$ I don't see why you think @whuber's characterization is either unfair or dismissive. He's basically saying that he doesn't believe there's going to be a meaningful answer—one other than what you've already classified as "trivial," and he outlines his reasons why. He's not the only one—I doubt it, too, and statsplease below apparently does as well. $\endgroup$
    – jbowman
    Commented Apr 3 at 15:02

3 Answers 3

4
$\begingroup$

The statement that the mean is greater than the median is simply a statement of $$F_{X}(\mathbb{E}[X])>0.5$$ for a random variable $X$ with distribution function $F_{X}(x)$.

This has nothing (directly) to do with skewness.

To impose a direct relationship between this statement and skewness (being positive) would just result in some inequality like

$$\mathbb{E}\bigg[\bigg(\frac{X-\mu}{\sigma}\bigg)^{3}\bigg]>0\quad\Rightarrow\quad \mathbb{E}[X^3]>\mathbb{E}[X](3σ^2+\mathbb{E}[X]^2)$$

where $\mathbb{E}[X]>F^{-1}_X(0.5)$ and $σ^2$ is taken to be finite.

Any distribution satisfying this inequality is what you're after.

$\endgroup$
10
  • 1
    $\begingroup$ Thanks, but I can't consider this a satisfying answer as it is basically just a restatement of my question. Yes, I'm after the distributions for which $F_X(\mu)>.5 \Leftrightarrow EX^3>\mu(3\sigma^2+\mu^2)$--but which distributions satisfy this? Is there a simple sufficient condition I can check in practice? $\endgroup$ Commented Apr 1 at 12:55
  • $\begingroup$ You asked under what conditions on $X$ can we conclude that positive skewness implies mean greater than median. That's what was answered. $\endgroup$ Commented Apr 1 at 13:24
  • 1
    $\begingroup$ The sort of answer I had in mind is one that introduces an additional property of X that is easier to verify than directly computing the skew, mean, and median, like "if X is unimodal and not heavy tailed, then Skew and mean-median have the same sign". I don't know whether this particular claim is true, it is just an example of what I would consider a satisfying answer. $\endgroup$ Commented Apr 1 at 13:53
  • $\begingroup$ I'm not sure the condition you're after exists. We can stipulate conditions like "no unimodal, continuous, symmetric distributions" (because naturally mean equals median) but the general condition you're after is the one already stated in the answer. We can pick specific families of distributions like Weibull and say any $X\sim\text{Weibull}(\lambda,k<3.439541\ldots)$. But once again that is just a specific application of the general condition above. $\endgroup$ Commented Apr 2 at 0:14
  • 1
    $\begingroup$ @statsplease, do you regard the condition in the first item of the OP’s answer as meaningful? $\endgroup$
    – user225256
    Commented Apr 4 at 12:37
1
$\begingroup$

This is a hard problem. Here are two special cases which seem difficult but tractable.

  1. Let $$Y=\frac1n \sum_{i=1}^n X_i$$ where the $X_i$ all come from the same lognormal $LN(\mu,\sigma)$ distribution. Is it true that $$Mean[Y] > Median[Y]\ ?$$ This is an open problem for $n\ge 5$, which I answered fully for $n=2$ and with a sketch for $n=3$ and $n=4$ here.

  2. Consider an exponential family of distributions defined by pdfs $$f(x|\theta)=h(x)g(\theta)e^{\eta(\theta)T(x)}$$ What are some nice conditions on $h,g,\eta,T$ which lead to $$mean>median \text{ for all }\theta\ ?$$ As formal criteria of niceness, we could require that the conditions apply in at least some cases with all four functions non-constant, and be stated without any integrals using products of the functions; asking for nice conditions informally would work too.

$\endgroup$
4
  • 1
    $\begingroup$ Thanks! Very interesting about the lognormals. I should clarify I don't have a formal notion of niceness in mind. Ideally the condition would include cases with both positive and negative skew, but really anything more parsimonious than just a laundry list of specific distributions would be interesting. $\endgroup$ Commented Apr 3 at 14:59
  • $\begingroup$ This comment tells me you really are fishing for a list of answers. Nobody denies that might be interesting, but it's a poor fit to our format here, where we address questions that have definitive, single answers if possible. $\endgroup$
    – whuber
    Commented Apr 3 at 15:14
  • $\begingroup$ @whuber The four top questions on this website over the last month are: "Is linear regression still relevant in a mid-level DS interview?", "Is descriptive statistics enough to compare test scores of students in a class?", "Are there situations where a vertical bar chart is preferable to a horizontal one?", "Do we believe in existence of true prior distribution in Bayesian Statistics?". None of these seem to me to have a definitive, single answer. $\endgroup$ Commented Apr 3 at 15:37
  • 3
    $\begingroup$ It's never a valid response to point out you believe we are not perfectly consistent in our moderation: how we moderate other threads has almost nothing to do with your thread. Although I haven't investigated all the questions you mention, the first one already is Community Wiki: that designates a thread potentially of some interest that is expected to accumulate a list of answers. That's why I made your thread CW. When you find a post you believe should be closed, then please flag it for our attention and we will look into it. $\endgroup$
    – whuber
    Commented Apr 3 at 15:41
1
$\begingroup$

Here are some results I found in the literature. I'll assume without loss of generality that $EX=0$ and $EX^2=1$ (in particular, $Skew(X)=EX^3$). I'll also assume that $X$ has a density function $p$.

  1. If $p(x)-p(-x)$ changes sign exactly once in $x$, then $$Skew>0 \iff Mean>Median$$ [Mac]. This includes all distributions from the Pearson family as well as lognormal and inverse Gaussian.

  2. If $X_1, X_2, \dots$ are independent copies of $X$ and $S_n$ is the sum of the first $n$ copies, then $$\lim_{n\to\infty} Median(S_n) = \frac{-1}{6}Skew(X)$$ This has certain technical assumptions which are not too stringent and can be founded in the referenced paper. (Due to [Hall], with an earlier version proved by [Hald]). Since $$Skew(S_n)>0 \iff Skew(X)>0$$ we thus expect $$Skew(S_n)>0 \iff Median(S_n)<0$$ for sufficiently large n.

The paper actually proves a stronger statement: namely that the median goes as $-{\frac 1 6}skew+{\frac C n}$, to leading order in $n$. Here $C$ is a certain explicit expression that involves the first five moments of $X$. This allows us to estimate a finite $n$ value for which the skew-median relation will hold. Namely, it holds for $S_n$ provided that $-{\frac 1 6}|skew|+{\frac {sign(skew)C} n}<0$.

[Hall] P. Hall, On the Limiting Behaviour of the Mode and Median of a Sum of Independent Random Variables, Annals of Probability, 1980,

[Hald] J Haldane,The mode and median of nearly normal distribution with given cumulants, Biometrika, 1942.

[Mac] H MacGillivray, The mean, median, and mode inequality and skewness for a class of densities, Australian Journal of Statistics, 1982.

$\endgroup$
8
  • $\begingroup$ #2 isn't really helpful w.r.t. your OP, as it's a characterization of the limiting behavior, not of an actual distribution. Also, providing a reference to a paywalled article, as you have with your reference for #1, is less helpful than you might think. $\endgroup$
    – jbowman
    Commented Apr 4 at 1:24
  • $\begingroup$ I edited this to make it look nicer to me, but feel free to revert if it doesn’t look nicer to you. Also, does item 2 require the limit to be divided by $n$? $\endgroup$
    – user225256
    Commented Apr 4 at 1:49
  • 1
    $\begingroup$ You have the explicit expressions by Hall — what is $C$ for $X$ lognormal $LN(\mu,\sigma)$? You might be able to answer the question about lognormals for almost all $n$. $\endgroup$
    – user225256
    Commented Apr 4 at 4:04
  • 1
    $\begingroup$ @Matt F. - I looked into this. The main technical condition in the Hall paper (which I omitted from the answer) is a certain bound on the characteristic function of X. According to Wikipedia, there is no known simple expression for the CF when X is lognormal, so unfortunately it doesn't seem like there would be an easy way to verify this condition holds. $\endgroup$ Commented Apr 6 at 20:35
  • 1
    $\begingroup$ That is disappointing in terms of extending the result…but a relief in justifying my description of the lognormal problem as open and difficult. $\endgroup$
    – user225256
    Commented Apr 7 at 2:03

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.