Understanding "variance" intuitively

Question

What is the cleanest, easiest way to explain someone the concept of variance? What does it intuitively mean? If one is to explain this to their child how would one go about it?

It's a concept that I have difficulty in articulating - especially when relating variance to risk. I understand it mathematically and can explain it that way too. But when explaining real world phenomena how do you make one understand variance and it's applicability in the 'real world', so to speak.

Let's say we are simulating an investment in a stock using random numbers (rolling a die or using an excel sheet, doesn't matter). We get some 'return on investment' by associating each instance of the random variable to 'some change' in the return. Eg.:

Rolling a 1 implies a change of 0.8 per \$1 in investment, a 5 a change of 1.1 per \$1 and so on.

Now if this simulation is run for about 50 times (or 20 or 100) we will get some values and the final value of the investment. So what does 'variance' actually tell us if we were to calculate it from the above data set? What does one "see" - If the variance turns out to be 1.7654 or 0.88765 or 5.2342 what does this even mean? What did/can I observe about this investment?? What conclusions can I draw - in lay man terms.

Please feel free to augment the question with that for standard deviation too! Although I feel it's 'easier' to understand, but something that would contribute to making it also 'intuitively' clear would be greatly appreciated!

Answer 1

I would probably use a similar analogy to the one I've learned to give 'laypeople' when introducing the concept of bias and variance: the dartboard analogy. See below:

The particular image above is from Encyclopedia of Machine Learning, and the reference within the image is Moore and McCabe's "Introduction to the Practice of Statistics".

EDIT:

Here's an exercise that I believe is pretty intuitive: Take a deck of cards (out of the box), and drop the deck from a height of about 1 foot. Ask your child to pick up the cards and return them to you. Then, instead of dropping the deck, toss it as high as you can and let the cards fall to the ground. Ask your child to pick up the cards and return them to you.

The relative fun they have during the two trials should give them an intuitive feel for variance :)

Answer 2

I used to teach statistics to a layman by jokes, and I found they learn a lot.

Suppose for variance or standard deviation the following joke is quite useful:

Joke

Once two statistician of height 4 feet and 5 feet have to cross a river of AVERAGE depth 3 feet. Meanwhile, a third statistician comes and said, "what are you waiting for? You can easily cross the river"

I am assuming that layman know about 'average' term. You can also ask them the same question that would they cross the river in this situation?

What are they missing that is 'variance' to decide "what to do in the situation?"

It's all about your presentation skills. However, jokes help a lot to the layman who wants to understand statistics. I hope it helps!

Answer 3

I disagree with a lot of the answers advocating people to purely think of variance as spread. As smart people (Nassim Taleb) have pointed out, when people think of variance as spread they just assume it is MAD.

Variance is a description of how far members are from the mean, AND it judges each observation's importance by this same distance. This means observations far away are judged more importantly. Hence squares.

I think the variance of a continuous uniform variable is the easiest to picture. Each observation can have a square drawn to it. Stacking these squares creates a pyramid. Cut the pyramid in half so half the weight is in one side and half is in the other. The face where you cut it is the variance.

Answer 4

I would focus on the standard deviation rather than the variance; the variance is on the wrong scale.

Just as the average is a typical value, the SD is a typical (absolute) difference from the average. It's not unlike folding the distribution over at the average and taking the average of that.

Answer 5

Have a lot of practice giving lectures about standard deviation and variance to a novice audience.

Lets assume, one knows about average already. By average (or e.g. median) - one gets a single value from many measurements (that is how one usually uses them). But it is very import to say, that knowing some average is not enough at all. The second half of the knowledge is what is the error of the value.

Skip the next 2 paragraphs of motivation if lazy

Lets say you have some measurement device, that costed 1 000 000\$. And it gives you the answer: 42. Do you think one paid 1 000 000\$ for 42? Phooey! 1 000 000 is paid for the precision of that answer. Because Value - costs nothing without knowing its Error. You pay for the error, not the value. Here is a good live example:

Commonly, we use a ruler to measure a distance. The ruler provides a precision around one millimeter (if you use metric system). What if you have to go beyond and measure something with like 0.1mm precision? - You probably would use a caliper. Now, it is easy to check, that a cheap ruler with mm scale costs cents, while reliable caliper costs ~$10. Two orders of magnitude in price for one order of magnitude in precision. And that is very usual ratio of how much one pays for smaller errors.

1. The problem. Lets say we have a thermometer (Choose a measurement device depending on what is closer to auditory).

   We did N measurements of the same temperature and thermometer showed us something like 36.5, 35.9, 37.0, 36.6, ... (see the pic). But we know that the real temperature was the same all the time, and values are different because in every measurement the thermometer lies to us a bit.

We can calculate the average (see red line on the picture below). Can we believe it? Even after averaging, does it have enough precision for our needs? For human health estimation for example?

How can one estimate how much this little scum lies to us?

2. Max deviation - the easiest but not the best approach. We can take the farthest point, calculate the distance between it and the average (red line) and say, that this is how thermometer lies to us, because it is maximum error we see. One could guess, this estimation is too rough. If we look at the picture, most of the points are around the average, how can we decide just by one point? Actually one can practice in naming reasons why such estimation is rough and usually bad.

3. Variance. Then... lets take all distances and calculate an average distance from the average (on picture - average distance between each point and the red line)!

   BTW, how to calculate a distance? When you hear the "distance" it translates to "subtract" in math. Thus we start our formula with $ (x_{i} - \bar{x})$ where $\bar{x}$ is the average (red line) and $x_{i}$ is one of the measurements (points).

   Then one could imagine that the formula of average distance would be summing everything and dividing by N:

   $$\frac{\sum(x_{i} - \bar{x})}{N} $$

   But there is a problem. We can easily see, eg. that 36.4, and 36.8 are at the same distance from 36.6. but if we put the values in the formula above, we get -0.2 and +0.2, and their sum equals 0, which is not what we want.

   How to get rid of the sign? At this points someone usually says "Take the absolute value of each point!". Taking an absolute value is actually a way to go, but what is the other way? We can square the values! Then the formula becomes:

   $$\frac{\sum(x_{i} - \bar{x})^{2}}{N} $$.

   This formula is called "Variance" in statistics. And it fits Much better to estimate the spread of our thermometer (or whatever) values, than taking just the maximum distance.

4. Standard deviation. But still there is one more problem. Look at the variance formula. Squares make our measurement units... squared. If the thermometer measures the temperature in °C (or °F) then our error estimation is measured in $°C^{2}$ (or $°F^{2}$). How to neutralize the squares? - Use the square root!

   $$\sqrt{\frac{\sum(x_{i} - \bar{x})^{2}}{N}}$$

   So here we come to the Standard Deviation formula which is commonly denoted as $\sigma$. And that is the better way to estimate our device precision.

Hope it was easy to understand. From this point it should be easy go to "68–95–99.7 rule", sampling and population, standard error vs standard deviation terms Etc.

P.S. @whuber pointed out a good related QA - "Why square the difference instead of taking the absolute value in standard deviation?"

Answer 6

I was sitting down trying to puzzle out variance and the thing that finally made it click into place for me was to look at it graphically.

Say you draw out a number line with four points, -7, -1, 1 and 7. Now draw an imaginary Y axis with the same four points along the Y dimension, and use the XY pairs to draw out the square for each pair of points. You wind up with four separate squares consisting of 49, 1, 1, and 49 smaller squares, each. Each of them contributes to an overall sum of squares which, itself, can be represented as a large 10 x 10 square with 100 smaller squares overall.

Variance is the size of the average square contributing to that larger square. 49 + 1 + 49 + 1 = 100, 100/4 = 25. So 25 would be the variance. The standard deviation would be the length of one of the sides of that average square, or 5.

Obviously this analogy does not cover the full nuance of the concept of variance. There are a lot of things that need explained, such as why we often use a denominator of n-1 to estimate the population parameter, instead of simply using n. But as a basic concept to peg the rest of a detailed understanding of variance to, simply drawing it out so I could see it helped immensely. It helps understand what we mean when we say that variance is the average squared deviation from the mean. It also helps in understanding just what relationship SD has to that average.

Answer 7

Imagine you ask 1000 people to correctly guess how many beans are in a jar filled with jelly beans. Now imagine that you are not necessarily interested in knowing the correct answer (which may be of some use) but you wish to get a better understanding of how people estimate the answer.

Variance could be explained to a lay person as the spread of different answers (from highest to lowest). You could continue by adding that if enough people were to questioned the correct answer should lie somewhere in the middle of the spread of 'guestimates' given.

Answer 8

I think the key phrase to use when explaining both variance and standard deviation is "measure of spread". In the most basic language, the variance and standard deviation tell us how well spread out the data is. To be a little more accurate, although still addressing the layman, they tell us how well the data is spread out around the mean. In passing, note that the mean is a "measure of location". To conclude the explanation to the layman, it ought to be highlighted that the standard deviation is expressed in the same units as the data we're working with and that it is for this reason that we take the square root of the variance. i.e. the two are linked.

I think that brief explanation would do the trick. It's probably somewhat similar to an introductory textbook explanation anyway.

Answer 9

I'd like to provide two perspectives:

1. I regard the variance of distribution as the moment of inertia with the axis that at the mean of the distribution and each mass as 1. This intuition would make the abstract concept concrete. The first moment is the mean of the distribution and the second moment is the variance.

2. Precision is the reciprocal of the variance. $\phi = \frac{1}{\sigma^2}$. The larger the variance the less the precision.

Reference:

1. A first course of probability 8th edition
2. Precision_(statistics)