Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

In my probability class the terms "sums of random variables" is constantly used. However, I'm stuck on what exactly that means?

Are we talking about the sum of a bunch of realizations from a random variable? If so, doesn't that add up to a single number? How does a sum of random variable realizations lead us to a distribution, or a cdf / pdf / function of any kind? And if it isn't random variable realizations, then what exactly is being added?

share|improve this question
1  
By 'realizations of a random variable' I assume you mean the actual observed values. What is being summed in the 'sum of random variables' is the random variables before they are observed. Imagine calculating the weight of the next 5 people to get on the elevator. You dont know their weights (yet) and so they are each a random variable. But you probably would like to know something about the distribution of the sum of their weights. –  PeterR May 1 at 19:33
    
@PeterR This is what I don't understand. How does it even make sense to talk about adding something that doesn't have a value yet? Is it a metaphorical type of summing? –  Gosset May 1 at 19:47
    
I think your problem is that you don't understand what is a random variable. If you get this concept then the sum will come easily too. –  Aksakal May 1 at 19:49
    
@Aksakal Isn't the fact that I posted this question evidence of that already? Perhaps if you do know it, you could clarify the concept? –  Gosset May 1 at 19:56
    
Great answers have been given. Another good example is the sum of two dice, $X+Y$. The result is clearly random (you don't know in advance what the sum of both of the die will be). We know that $X,Y\sim Unif(1,6)$ and independent. It turns out that $X+Y$ has a triangular distribution. –  Benjamin May 2 at 12:00

4 Answers 4

up vote 25 down vote accepted
+50

A physical, intuitive model of a random variable is to write down the name of every member of a population on one or more slips of paper--"tickets"--and put those tickets into a box. The process of thoroughly mixing the contents of the box, followed by blindly pulling out one ticket--exactly as in a lottery--models randomness. Non-uniform probabilities are modeled by introducing variable numbers of tickets in the box: more tickets for the more probable members, fewer for the less probable.

A random variable is a number associated with each member of the population. (Therefore, for consistency, every ticket for a given member has to have the same number written on it.) Multiple random variables are modeled by reserving spaces on the tickets for more than one number. We usually give those spaces names like $X,$ $Y,$ and $Z$. The sum of those random variables is the usual sum: reserve a new space on every ticket for the sum, read off the values of $X,$ $Y,$ etc. on each ticket, and write their sum in that new space. This is a consistent way of writing numbers on the tickets, so it's another random variable.

Figure

This figure portrays a box representing a population $\Omega=\{\alpha,\beta,\gamma\}$ and three random variables $X$, $Y$, and $X+Y$. It contains six tickets: the three for $\alpha$ (blue) give it a probability of $3/6$, the two for $\beta$ (yellow) give it a probability of $2/6$, and the one for $\gamma$ (green) give it a probability of $1/6$. In order to display what is written on the tickets, they are shown before being mixed.

The beauty of this approach is that all the paradoxical parts of the question turn out to be correct:

  • the sum of random variables is indeed a single, definite number (for each member of the population),

  • yet it also leads to a distribution (given by the frequencies with which the sum appears in the box), and

  • it still effectively models a random process (because the tickets are still blindly drawn from the box).

In this fashion the sum can simultaneously have a definite value (given by the rules of addition as applied to numbers on each of the tickets) while the realization--which will be a ticket drawn from the box--does not have a value until it is carried out.

This physical model of drawing tickets from a box is adopted in the theoretical literature and made rigorous with the definitions of sample space (the population), sigma algebras (with their associated probability measures), and random variables as measurable functions defined on the sample space.

This account of random variables is elaborated, with realistic examples, at "What is meant by a random variable?".

share|improve this answer
3  
+1 exemplary post. I hope you don't mind the impertinent question, but what was the illustration done in? –  Glen_b May 1 at 23:01
4  
@Glen_b PowerPoint :-). The image of a box is from mymiddlec.files.wordpress.com/2013/09/empty-box.jpg. The tickets are PowerPoint graphics. (There's nothing impertinent about such questions!) I grouped the whole bunch, pasted it into Paint, and used that to save it as a .png file. –  whuber May 2 at 1:48
    
Thanks. The box image is very nice, and the graphic works very well in the context. –  Glen_b May 2 at 2:06
    
+1 very nice post! –  juampa May 7 at 11:17

there is no secret behind this phrase, it is as simple as you can think: if X and Y are two random variables, their sum is X + Y and this sum is a random variable as well. If X_1, X_2, X_3,...,X_n and are n random variables, their sum is X_1 + X_2 + X_3 +...+ X_n and this sum is also a random variable (and a realization of this sum is a single number, namely a sum of n realizations).

Why do you talk so much about sums of random variables in the class? One reason is the (amazing) central limit theorem: if we sum many independent random variables, than we can "predict" the distribution of this sum (almost) independently of the distribution of the single variables in the sum! The sum tends to become a normal distribution and this is the likely reason why we observe the normal distribution so often in the real world.

share|improve this answer
    
I am not comfortable in statistics. But a general understanding of mine suggests that you are correct. hence you need an applause. –  subhash c. davar May 8 at 8:56

r.v. is a relation between the occurrence of an event and a real number. Say, if it's raining the value X is 1, if it's not then 0. You can have another r.v. Y equal to 10 when it's cold, and 100 when it's hot. So, if it's raining and cold then X=1, Y=10, and X+Y=11.

X+Y values are 10 (not raining cold); 11 (raining,cold), 100 (not raining,hot) and 110 (raining, hot). If you figure our probabilities of the events, then you'll get PMF of this new r.v. X+Y.

share|improve this answer

A random variable is a practitioner's term for what most students know as "function". More specifically, it is a function for which the expected value is defined. So, a sum of random variables is just a sum of functions.

share|improve this answer
1  
Welcome to the site! What did you intend to say with your second sentence (since, as stated, it's clearly false)? –  cardinal May 3 at 20:42

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.