2
$\begingroup$

Suppose I have some data, and use this data to create a posterior distribution.

Now suppose I have some new data that I believe is from the same population as the data before. Can I now use my old posterior distribution as a new prior, given my new data?

$\endgroup$
2
  • 1
    $\begingroup$ In theory, absolutely! Yesterday's posterior can and should be today's prior. The devil is in the (practical) detail: unless you're working with conjugate models, your posterior is going to be a bunch of MCMC samples which aren't that easily expressed in a functional form required for your new prior. $\endgroup$
    – Durden
    Commented Dec 18, 2023 at 17:19
  • $\begingroup$ Just for future reference: there's a convenience function called posteriorSamplesToParametricPrior in the RevGadgets R package that might be of help to you. $\endgroup$
    – Durden
    Commented Dec 20, 2023 at 18:24

1 Answer 1

5
$\begingroup$

Usually, in most cases, practically speaking, the posterior distribution will be a bunch of normal distributions on each of the parameters. For example, suppose you have data for the height of men and women in some population. You will have 4 parameters, mean_men, mean_women, sigma_men, sigma_women. To keep things as simple as possible we will assume these 4 parameters are normally distributed.

However, when using Bayesian inference, each of those 4 parameters will follow a posterior distribution. So we treat them as random variables and not as fixed unknown quantities. You use your data to fit a posterior distribution on each of those 4 parameters.

In practice, you often use MCMC and if you have enough data then it is pretty common that each of the parameters themselves is normally distributed. Therefore, let us say, that you estimate from your MCMC simultion that mean_men is 70 inches but with a deviation of 3 inches. This means your prior will become $\mathbf{Normal}(70, 3^2)$ on the mean_men parameter only.

Just be careful, sigma_men is a different parameter, so you should not use the number of 3 inches from before in its estimate. Rather the number here will follow from a different calculation.

$\endgroup$

Not the answer you're looking for? Browse other questions tagged or ask your own question.