4
$\begingroup$

What distribution does this histogram look like?

enter image description here

It doesn't seem symmetric around its mean, and it is always nonnegative and unimodal. After its mode, it seems to decay exponentially to infinity, while before its mode, it seems to increase in some different way.

How, in general, can we guess the distribution from a histogram? Are there some references or summaries for teaching me to do that? Thanks!

$\endgroup$
11
  • 1
    $\begingroup$ Thanks! How did you learn to know that? DO you keep a summary of these distributions, so whenever you saw a histogram, you can think of some possible distributions? $\endgroup$
    – Tim
    Commented Feb 22, 2014 at 13:52
  • 3
    $\begingroup$ I would rather guess a distribution from a kernel density estimate, or even more than one (with different smooth). Histograms' appearance can change dramatically with different bin widths and starting points. $\endgroup$
    – Peter Flom
    Commented Feb 22, 2014 at 13:59
  • $\begingroup$ @PeterFlom: Can I ask you the same question? How did you learn to tell from a histogram? Do you keep a summary of these distributions, so whenever you saw a histogram, you can think of some possible distributions? $\endgroup$
    – Tim
    Commented Feb 22, 2014 at 14:17
  • $\begingroup$ I didn't follow any particular learning path; I am not that expert at this. $\endgroup$
    – Peter Flom
    Commented Feb 22, 2014 at 14:29
  • 5
    $\begingroup$ Histograms are poor tools for estimating distributions: see stats.stackexchange.com/a/51753. Therefore it would be foolhardy to hazard a guess based on this one. Certain forms of summary statistics provide more powerful tools for estimating distributions. In addition to the usual (first few moments, etc.), having extreme quantiles (the quartiles, eighths, and so on) can be very helpful. The first four moments alone often do a good job. $\endgroup$
    – whuber
    Commented Feb 22, 2014 at 14:44

1 Answer 1

4
$\begingroup$

1) Beware trying to assess distributional shape from a histogram with only a few bars. On occasion, you can get a misleading impression, especially if sample sizes are small. If sample sizes are big, use far more bars.

2) There are an infinite number of unimodal, slightly right skew distributions. There is no reliable way to discriminate one from any number of others.

3) Real data tends not to follow the simple distributional shapes of the common one-, two- or three- parameter distributions. Real distributions are more like heterogeneous mixtures. Simple distributional forms are convenient fictions (models, to be precise) - they approximate reality in ways that make it easier to work with.

With large samples of real data, it makes sense to work directly with the distribution you have (of which the ecdf is the sample estimate); kernel (or log-spline) density estimates give you nice smooth curves and can help you pick out modes and so on.

It doesn't seem symmetric around its mean, and it is always nonnegative and unimodal. After its mode, it seems to decay exponentially to infinity, while before its mode, it seems to increase in some different way.

I'd agree.

How, in general, can we guess the distribution from a histogram?

In general, you can't.

Are there some references or summaries for teaching me to do that?

Not really, since you can't really do it without narrowing the problem down (e.g. see my discussion below about how to tell a gamma from a lognormal).

What you can do is simulate many samples from distributions (at each of a number of different sample sizes) to get an idea of what they look like, and how much they can vary.


At first glance it looks like it might kind of be close to a gamma distribution.

But it might be closer to lognormal. (But it might be any of an infinity of other things, as I mentioned)

If those were the only two possibilities and I had to choose between them, I'd look at the distribution of the logs.

When you take logs, what was gamma becomes left-skew:

enter image description here

Lognormals become symmetric (obviously):

enter image description here

So that's an easy way to distinguish between those two possibilities. If it's still slightly right-skew after you take logs, I'd look at inverse gamma as one possibility.

But once you do that with actual data, don't make the mistake of thinking of your choice as anything more than a model.

(There are a number of posts here that discuss identifying distributions from histograms or Q-Q plots or kernel density estimates that make related points. Some of those are worth looking at.)

$\endgroup$
5
  • $\begingroup$ Thanks. By the way, the histogram is from stats.stackexchange.com/questions/87504/… $\endgroup$
    – Tim
    Commented Feb 23, 2014 at 1:26
  • 1
    $\begingroup$ Ah, but if you're in that situation, you have far more information than just the sample! It should be possible, for example, to actually compute the density function (at least numerically). $\endgroup$
    – Glen_b
    Commented Feb 23, 2014 at 2:41
  • $\begingroup$ How do you compute the density function numerically? $\endgroup$
    – Tim
    Commented Feb 23, 2014 at 16:58
  • $\begingroup$ That would be a whole other question, but it relates to what I was saying in comments on your other question (about convolutions of logs of scaled F distributions). So, specifically, you do numerical convolution - typically via fast Fourier transforms. Once you have the density on the log scale you can then transform the result back. $\endgroup$
    – Glen_b
    Commented Feb 23, 2014 at 17:22
  • $\begingroup$ You can compare a histogram with one of the 88 histograms/PDFs of these distributions available in a python library (scipy.stats) or you can try to fit the histogram to a variety of distributions and see which one produces the least amount of error. $\endgroup$ Commented Jun 2, 2016 at 15:01

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.