2
$\begingroup$

This comes from operations analysis. Often you have measurement of times, such as time between customers arriving at a store (e.g. Starbucks) or time it takes to process an order (e.g. a cappuccino).

Say you have two such variables X and Y, with X being time between customer arrival and Y being time required to process an order. Usually X is exponentially distributed (customers-per-hour would be the related Poisson distribution). In some processes, Y (time-to-process) is sometimes normal and sometimes exponential.

My question is this: if I observe a variable Y that intuitively could be normal or exponential, and I find that the mean equals the standard deviation (a characteristic of exponential distributions), can/should I assume that the distribution is exponential and not normal? Would either assumption work?

TL;DR More generally, if I have a variable for which the mean and standard deviation are equal, what is the general likelihood that the distribution is normal vs exponential? (I don't have actual data. This is more conceptual.)

[Edited: Replaced "probability" with "general likelihood" to be more specific.]

[Edited again: This question was motivated by an over-simplified textbook question that sparked my own conceptual question (being more deeply ingrained and interested in statistics than the class required). It has clarified the absurdity of the over-simplification. More precisely: any thing in operations measured as process time is not normally distributed. Exponential and lognormal distributions are often good candidates. This is true because you cannot have negative process time. However a normal approximation is often used because it is better understood and easy to teach. If I wrote the question again, I'd ask for examples where a normal approximation could result in a substantively bad analysis or recommendation. Thanks to all who helped!]

$\endgroup$
5
  • 1
    $\begingroup$ If you have a normal variable with mean = standard deviation, then it has a 16% probability of being negative (i.e. $\Phi[-1]=0.16$, see here). So a non-negative variable can only be truncated normal at best. $\endgroup$
    – GeoMatt22
    Commented Oct 14, 2016 at 6:58
  • 1
    $\begingroup$ (There are of course many non-negative PDFs which could work besides exponential.) $\endgroup$
    – GeoMatt22
    Commented Oct 14, 2016 at 7:02
  • 1
    $\begingroup$ The question does not make sense, as there is no intrinsic probability distribution on the space of all probability distributions. And you mention observations in the same sentence as mean and standard deviation, which makes me wonder whether or not you mean estimates of both mean and standard deviation. $\endgroup$
    – Xi'an
    Commented Oct 14, 2016 at 9:03
  • 1
    $\begingroup$ @Xi'an You are clearly right that "probability" in the title cannot be taken literally here. I've interpreted the question is being at most "How likely is it..." but it's for the OP to reword. $\endgroup$
    – Nick Cox
    Commented Oct 14, 2016 at 18:26
  • 1
    $\begingroup$ For the title, you might include "non-negative variable", as that seems the focus. And you might re-word more like "what options besides exponential?", because as Xi'an notes it is really not possible to ask about "probability", and I would say "general likelihood" has the same issue. (It is a qualitative issue, not a quantitative one.) $\endgroup$
    – GeoMatt22
    Commented Oct 14, 2016 at 20:38

1 Answer 1

5
$\begingroup$

Any talk here of probability must at best be informal without a precise idea of what set-up you are notionally sampling from. But it's clear that a normal with mean and SD equal must have both positive and negative values, as a large fraction of data must be below mean $-$ SD, which equals zero. Distributions like that are possible but fairly unusual in my experience. Distributions of residuals from some model are examples of distributions with both positive and negative values, but their mean and SD being equal would be very unusual and -- whenever mean residuals are necessarily zero, as with some fitting procedures -- mean certainly cannot equal SD, unless trivially all residuals are zero. (Any set of values which are deviations from their mean is a case in point.)

In contrast it's always true for an exponential that the mean and the SD are equal, although the converse doesn't follow. (For example, a Poisson with mean 1 also has SD 1 but is not an exponential.)

I can't say that a decision on normal or exponential is ever one that statistical people face seriously. A normal distribution is always symmetric and an exponential distribution always skewed and bounded. It should be apparent from simple graphs that one or other distribution may be plausible, but not both. Perhaps their simplest meeting place is the gamma family of distributions as the exponential and normal are both members, the latter as a limiting case.

Say what should be said about Wikipedia, but I've found its articles on individual probability distributions informative and well illustrated. See e.g. the entry on the exponential

Your example is one where time-to-process is always positive, so normal distributions are strictly impossible. I'd expect marked skewness in many situations but approximate symmetry is also possible, e.g. when serving up burgers or coffee. But then necessarily the mean must be larger than the SD for symmetry to be possible, exactly or approximately.

$\endgroup$
1
  • $\begingroup$ "it's clear that a normal with mean and SD equal must have both positive and negative values, as a large fraction of data must be below mean SD, which equals zero. Distributions like that are possible but fairly unusual in my experience."This makes sense. In an operational setting abnormal distribution with equal means and standard deviations would virtually never occur. (I.e. You'll never have negative processing times.) I just finished an Operations class and looking back, after reading these comments, I'm guessing that many non-normally distributed events were normal approximated. $\endgroup$ Commented Oct 14, 2016 at 19:46

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.