2
$\begingroup$

I have been asked that question, and it's very weird to me. I know how a random variable/distribution can basically not have a mean due to diverging integral of its expected value.

But how is it possible that the mean of a random variable "exists"/can be defined, but not be stable? What are some examples of such distributions?

Thanks in advance.

$\endgroup$
6
  • 3
    $\begingroup$ $Y\sim N(\mu,\sigma_1^2)$ and $\mu \sim N(0,\sigma_2^2)$. Then mean of $Y$ is unstable. $\endgroup$
    – user158565
    Commented Aug 12, 2019 at 5:40
  • 1
    $\begingroup$ Distributions can be contingent on more than one variable. For example, the joint density to find an object at position $x$ at time $t$ can be denoted $p(x,t)$. Then the mean position of the object $\langle x(t) \rangle = \int x p(x,t)dx$ is generally a function of time as opposed to constant. $\endgroup$ Commented Aug 12, 2019 at 6:21
  • 1
    $\begingroup$ @user158565 That example has a straightforward mean that we get by integrating out $\mu$ and $\sigma_2)? The example by kevinkayaks makes more sense to me - i.e. the mean is determined by some other things that change. $\endgroup$
    – Björn
    Commented Aug 12, 2019 at 7:11
  • 2
    $\begingroup$ The mathematical definitions imply the expectation is a number or does not exist. Any other answer has to modify the usual sense (either explicitly or implicitly) of "random variable." $\endgroup$
    – whuber
    Commented Aug 12, 2019 at 12:32
  • 1
    $\begingroup$ @whuber what wouls you say to the above about the mean of the posterior predicitve distribution? $\endgroup$ Commented Aug 14, 2019 at 10:07

1 Answer 1

2
$\begingroup$

Yes it can. In fact this is crucial in Bayesian Analysis where we are modeling something according to some distribution but we are unsure of paramaters in it. Exactly like user158565 commented. In his case, if we want to sample from Y, we first sample a mean from $\mu$'s distribution, then using that we sample a Y by the distribution defined by this $\mu$. We can keep nesting distributions one after the other like this!

Practically these things change for a system due to natural fluctuations. Check out bayesian linear regression for a quick example. The posterior predictive distribution tries to encapsulate both these into one distribution. Otherwise Statistical Rethinking is a light book to read abit more.

$\endgroup$
2
  • 1
    $\begingroup$ Thanks. There is an issue here: given that with Bayes, one can (for cases, analytically) calculate the posterior probability density of such distribution, doesn't that mean there would be a unique mean for the posterior distribution? $\endgroup$
    – psyguy
    Commented Aug 12, 2019 at 14:57
  • 1
    $\begingroup$ Yes I would say so, I did not think of this case. If you get a better answer please link it here. $\endgroup$ Commented Aug 14, 2019 at 10:06

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.