0
$\begingroup$

Given the observations' density $f(X|\theta) = \mathcal{N}(\theta,1)$ and the prior density $f(\theta) = \mathcal{N}(0,\sigma^2)$, it it is said that it is obvious that the posterior density is equal to : $\mathcal{N}(\frac{X}{1+\sigma^{-2}},\frac{1}{1+\sigma^{-2}})$.

I use following relation to compute the posterior density : $f(\theta|X) = \frac{f(X|\theta)f(\theta)}{\int f(X|\theta)f(\theta)d\theta}$, but I dont find it obvious at all...

Any help appreciated

$\endgroup$
2
  • 1
    $\begingroup$ Obiousness is in the mind of the beholder: it depends on what one knows and can bring immediately to mind. Thus, your question is predicated on some understanding of what you are expected to know. For instance, are you familiar with the theory of linear regression? With the bivariate Normal family of distributions? What material would be appropriate to invoke when providing an answer? $\endgroup$
    – whuber
    Oct 29, 2019 at 17:41
  • 1
    $\begingroup$ @whuber this the correction of an exercise in a statistic course. Here the obviousness means that it don't need much computation to arrive at this result. Knowledge on normal distribution and bayesian modeling are effectively assumed $\endgroup$ Oct 29, 2019 at 18:52

1 Answer 1

2
$\begingroup$

You are on the right track. Substitute expressions for the densities of normals into the Bayes law (and don't keep track of constants !!)

\begin{align} f(\theta|X) &\propto \exp(-\frac{1}{2}(X-\theta)^2)\cdot \exp(-\frac{1}{2}\sigma^{-2}\theta^2)\\ & \propto \exp(-\frac{1}{2} ((1+\sigma^{-2})\theta^2 - 2 \theta X + X^2)) \\ & \propto \exp(-\frac{1}{2} (1+\sigma^{-2}) (\theta^2 - 2 \theta \frac{X}{1+\sigma^{-2}})) \\ & \propto \exp(-\frac{1}{2} (1+\sigma^{-2}) (\theta - \frac{X}{1+\sigma^{-2}})^2) \end{align}

The latter is the kernel of a normal $\mathcal N (\frac{X}{1+\sigma^{-2}}, \frac{1}{1+\sigma^{-2}})$.

$\endgroup$
2
  • 1
    $\begingroup$ Great answer ! Thanks $\endgroup$ Oct 30, 2019 at 22:46
  • 1
    $\begingroup$ That was my first!! Thanks and my pleasure! $\endgroup$
    – Konstantin
    Oct 31, 2019 at 10:26

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.