The expected value of a random variable is a weighted average of all possible values a random variable can take on, with the weights equal to the probability of taking on that value.

learn more… | top users | synonyms

0
votes
0answers
18 views

Expectation of a generalization of Dirichlet distribution

For the standard Dirichlet, the expectation of $X_i$ is $\alpha_i/\alpha_0$, where $\alpha_0 = \sum_i \alpha_i$ (http://en.wikipedia.org/wiki/Dirichlet_distribution). I am considering the following ...
2
votes
1answer
46 views

Bounded expectation implied bounded conditional or vice versa?

If $\mathrm{E}\left(X\right)<\infty$ does that imply $\mathrm{E}\left(X|Y\right)<\infty$? How about vice versa? I'm thinking if we condition on an event (say $Y>2$) then if we have ...
2
votes
2answers
81 views

Probability that a sum of potential numbers is greater than some value

Say I am about to receive 5 cash prizes and I have the probability of receiving each cash prize. Let's denote a set of cash prizes with $k$. So, below is the set of cash prizes and the set of ...
0
votes
0answers
6 views

Problem with calculating the avarage power of a vector? [migrated]

I am calculating the average power of a vector. I would like to compare it the final expression with the simulation. However, they are not equal. Please help me to point out which steps are wrong. ...
-1
votes
0answers
38 views

Given the data set is the Bayesian estimation the best solution for solving the expected value? [closed]

I am very new to this. I have several measurements from different instrument about a parameter A. Each of the measurements comes with an estimated error. I know that the observation error is biased, ...
0
votes
1answer
83 views

Drunken cockroach - Trying to meet expected value

Imagine that you have $1000 that you can split however you want. You bet in a cockroach run, but it is not the finish that's interesting. You can bet for the cockroach to go left or right, and you ...
1
vote
0answers
22 views

How to understand Demartines theorem [migrated]

Demartines theorem (page 3) explain why norm of a random vector increases with dimension, whereas its variance remains constant: Let $X \in \mathbb{R}^d$ be a random vector with i.i.d. components: ...
0
votes
1answer
55 views

$E(X_1| \overline X ) = \overline X$, the sample mean

Let $X_1, X_2, ..., X_n$ be a random iid sample from a population with mean $\theta$. Now I am wondering about the intuition behind $E(X_1| \overline X ) = \overline X$, the sample mean. If we just ...
7
votes
1answer
63 views

Distribution of the Rayleigh quotient

For a research project I need to find the expected value of the generalized Rayleigh quotient: $$E\,[w^T A w \ / \ w^T B w].$$ Here A and B are positive definite deterministic p x p covariance ...
0
votes
0answers
21 views

How do you prove that if $ X_t \sim^{iid} (0,1) $, then $ E(X_t^{2}X_{t-j}^{2}) = E(X_t^{2})E(X_{t-j}^{2})$? [duplicate]

Suppose we have a time series $X_t$ s.t. $X_t \sim^{iid} (0,1)$. How do you prove that if $ X_t \sim^{iid} (0,1) $, then $ E(X_t^{2}X_{t-j}^{2}) = E(X_t^{2})E(X_{t-j}^{2})$? Or, I guess, if ...
0
votes
0answers
12 views

Expected agreement if random

I am looking to measure agreement between participants in choosing which member of a group is most like certain attributes. I want to calculate the expected agreement if they were to choose by chance. ...
1
vote
0answers
25 views

Non-Measure Theoretic Argument for Var(X) = 0 iff X is constant (X continuous RV)

I am studying out of DeGroot and Schervish trying to carefully understand the math of prob/stats. In ch 4.3 on variance, they state the theorem that given X a RV whose mean and var exist, then Var(X) ...
8
votes
2answers
198 views

Percentile Loss Functions

The solution to the problem: $$ \min_{m} \; E[|m-X|] $$ is well known to be the median of $X$, but what does the loss function look like for other percentiles? Ex: the 25th percentile of X is the ...
1
vote
1answer
39 views

Variance of sample mean for dependent samples

Suppose I have two discrete independant random variables $X$ and $Y$, and that I'm interested in the expected value of the random variable $W$, where: $$ W= \text{sign}(X-Y). $$ So, W is 1 if ...
5
votes
3answers
296 views

Let f(x) be some PDF, and F(x) be its CDF. Shouldn't F(x)=.5 give us the expected value of f(x)?

I was playing around in R and have gotten myself very confused about the relation between probability distributions, their expected values, and their cumulative distribution functions. Say we're ...
4
votes
0answers
115 views

How to find this integral [duplicate]

Let $X_1, \cdots, X_n$ be $iid$ normal random variables with unknown mean $\mu$ and known variance $\sigma^2$. How to find $E[\Phi(\bar X)]$, where $\bar X:=\frac{\sum_{i=1}^nX_i}{n}$, please? I guess ...
0
votes
0answers
21 views

Showing that the variance increases with the dimension of the random vector

This is actually related to a more complex question; but I want to re-ask it by trying to simplifying it as possible: 1- We have $n$ dimensional functions of the form $f_n:\mathbb{R}^{n} \mapsto ...
0
votes
1answer
45 views

Expectation values of functions

This question is more to do with interpretation than calculation. I have a model which predicts the probability of a detector 'firing' under a certain intensity of signal, or actually in this case ...
0
votes
1answer
18 views

Multinomial chi square with small expected values

I'm studying extinction in Austronesian languages, and am trying to find out if a subset of 384 languages is randomly selected with respect to extinction risk from a population of 1249 languages. ...
0
votes
0answers
19 views

sufficient statistic and KL-divergence: Confusion with an equation

I am reading a paper, which talks about minimising KL-divergence of any arbitrary distribution over a family of exponential distribution. So, given a distribution $p$, we want to compute its ...
4
votes
1answer
42 views

Estimating the error in the average of correlated values

tl;dr I can only generate samples of a random variable $X$ using MCMC. How can I find the error in the estimate of the expected value of $X$ based on this MCMC data? The problem I have a "black ...
3
votes
1answer
75 views

dG(y) in expected value integral

I am wondering what exactly the notation dG(y) inside an integral means, what it's called and where I can read more about it: $$E[B_1]=\int_0^{\infty}E[B_1 \vert Y_1 = y] dG(y)$$
3
votes
1answer
78 views

Why is the conditional expectation of prediction error in regression not zero?

The conditional expectation of the error in regression is: $E[Y-X\beta|X=x]$ is not equal to 0. Why is this the case? If you fix all the predictor variables, why does $E[Y]$ - $X\beta$ not equal to ...
1
vote
0answers
68 views

Practical meaning of expected value, standard deviation & correlation

We've got given annual results of two stock companies described with following values: Company X: expected value $\mu_X=0.05$, standard deviation $\sigma_X=0.02$ Company Y: expected value ...
2
votes
1answer
54 views

Is it true that if $ \epsilon_t \sim^{iid} (0,1) $, then $ E(\epsilon_t^{2}\epsilon_{t-j}^{2}) = 1 $?

Under the GARCH($m$,$s$) model, it can be shown that $ E(\eta_t\eta_{t-j}) = E[(a_t^{2}-\sigma_t^{2})(a_{t-j}^{2}-\sigma_{t-j}^{2})] = 0 $. In my proof attempt, I came across $ ...
2
votes
2answers
80 views

Confused about why we would use expected value instead of MLE when estimating some parameter

I have a conceptual confusion about the use of the expected value of a distribution. Often, we want to estimate the most likely value of something. For example, I have X= ten observations. I know X ...
0
votes
1answer
46 views

the Poisson result and Exponential interpretation for spare part requirement analysis

I am confused with with the Poisson result and Exponential interpretation for spare part requirement analysis. I try to calculate the required number of spare parts for a disposable remove-replace ...
1
vote
1answer
39 views

Expectation of Truncated & Random Variable

I have what appears to be a relatively simple question, but am struggling to understand how to go about answering it. The general question is as follows: What is the expected value of $S_{I}$, ...
1
vote
1answer
236 views

Expected value of a random variable

Random variable $X$ has the probability density function \begin{equation*} f\left( x\right) =\left\{ \begin{array}{ccc} n\left( \frac{x}{\theta }\right) ^{n-1} & , & 0<x\leqslant \theta ...
0
votes
2answers
52 views

Expected value of multiplication of Identically distibuted random variables

i am trying to understand if the following statement is true: $$ E(XY)= E(X^2)=E(Y^2) $$ if $X$ and $Y$ are identically distributed but not necessarily independent r.v. This means that if the ...
2
votes
1answer
96 views

Expected value of inverse?

If I have a random variable $V$ that is normally distributed with some $\mu$ and $\sigma$, then what is the expected value of $1/V$? I tried doing by delta method, and I get expected value $1/\mu$, ...
0
votes
0answers
49 views

Difference between absolute deviation to population median and sample mean

I have independent variables $X_i\in[0;1]$ and suppose they are uniformly distributed. If you want to minimize the total absolute deviation to a fixed number, how much can you gain from using the ...
1
vote
0answers
44 views

Testing if alcohol consumption and smoking are independent

The question asks to test if smoking status and level of alcohol consumption are independent using the usual five-step procure at alpha $=0.05$: I am having trouble finding expected values. As the ...
12
votes
2answers
540 views

Why maximum likelihood and not expected likelihood?

Why is it so common to obtain maximum likelihood estimates of parameters, but you virtually never hear about expected likelihood parameter estimates (i.e., based on the expected value rather than the ...
0
votes
0answers
68 views

Total waiting time at a server with exponential arrival times

Question: In a certain system, a customer must first be served by server 1 and then by server 2. The service time at server $i$ is exponential with rate $\mu_i$, $i = 1, 2$. An arrival finding server ...
1
vote
0answers
53 views

In EM derivation why can I sum over the iid variables in the conditional expectation?

In EM when you take the expectation: $E[\log P(y,x \mid \theta)\mid x, \theta']$ $= \sum\limits_yP(y\mid x, \theta') \log P(y,x\mid \theta)$ I understand this but the following part I don't ...
5
votes
1answer
62 views

Does A independent of B, and B correlated with C imply that C is independent of A?

Assume 3 random variables, $A, B, C$. If $A \perp B$, but $Cov(B,C) \neq 0$, can we say anything about $Cov(A,C)$? I think it can either be 0 or not 0, but it seems like there should be more general ...
3
votes
2answers
86 views

Waiting time for successive occurrences of a result, when rolling a dice

In consecutive throws of an ordinary dice, which of the following two possibilities is more likely to happen first: a) Two successive occurrences of 5 or b) Three successive appearances of numbers ...
2
votes
1answer
35 views

How many times, in expectation, am I fetching a random sample from a predefined discrete probability distribution of elements?

As part of a simulation that I'm working on, I have a probability distribution over $n$ elements, from which I have to sample a set $S$ of size $m$. That is, each element $e \in S$ must be unique ...
1
vote
0answers
61 views

In a linear regression, why is the mean of all $y_i$ equal to 0?

I don't understand why the mean for all $y_i$s must equal $0$. What property/properties does the above assertion rely on? I had thought that the mean of $y_i=E(y_i)$, so: $$ E(y_1)=\alpha $$ $$ ...
1
vote
0answers
33 views

Interpretation of Count Models Based on Weibull Interarrival Times?

This question is an extension of this question, but more specific. This paper E. Bradlow et al is a Weibull counting model which I am using to estimate how many failures will happen between ...
0
votes
1answer
45 views

Relation between mean of the hypergeometric distribution and binomial

The mean of the hypergeometric distribution is: $n \frac{K}{N}$ where: $n$ is the number of draws $K$ is the number of successes N is the size of the finite population. As the population size, ...
0
votes
0answers
17 views

Maximizing expectations vs Mode maximization

In many statistical problems, I see the following formulation for maximizing rewards: Assuming that my total reward $R$ is the sum of individual rewards $R$: ...
0
votes
1answer
70 views

Expectation / minimizing variance of weighted sum of means

(I'm assuming the second $\bar x$ should be a $\bar y$), but I'm mostly confused how to solve this problem because it seems like since $\bar x$ and $\bar y$ are values, not random variables, $W$ is ...
0
votes
0answers
19 views

Conditional distribution of Inverse Wishart

Suppose $\begin{bmatrix} K_{11} K_{12}\\K_{12}^T K_{22} \end{bmatrix}\sim\mathcal{IW}\left(\eta,\begin{bmatrix} \Sigma_{11} \Sigma_{12}\\\Sigma_{12}^T \Sigma_{22} \end{bmatrix}\right)$. What is the ...
1
vote
1answer
56 views

How to compare observed and expected outcomes for continuous data

I am working on some data, more specifically some predictions of some outcomes. The predictions vary on the continuous scale, between $-3$ and $3$. They can for example be: $x_1=-2.4, x_2=-2.1, ...
1
vote
0answers
22 views

Intuition behind Expected Value of conversion events

I'm trying to develop a high level model to value events in a marketing conversion funnel. To take a simple e-commerce example: You start with leads in the form of ad clicks. Some % of these ad ...
5
votes
1answer
101 views

E[g(Y)] proof question

This is one of the theorems in my stats text, and I need some help understanding the proof. How can the summand($g_{i}$) be out of its summation sign when multiplying? I thought you can never ...
0
votes
0answers
46 views

Finding the MSE of the MLE of N?

If X is taken from a uniform discrete distribution, how can I find the MSE of the MLE of N? (I got disturbing and contradictory answers). I am having some trouble with calculating the mean squared ...
1
vote
1answer
139 views

how can calculate $E(X^Y|X+Y=1)$

let $X,Y$ are two independent random variables Bernoulli with probability $P$. how can calculate $E(X^Y|X+Y=1)$