# Prior for the coefficients of a linear regression model

I have a linear regression model $\bf Y=\bf{X}\bf{\beta}+\epsilon$. I want to assign a prior on $\bf\beta$ in order to derive the posterior predictive model $p(y_{predictive}|\bf{y},\bf{X},\beta)$. How do I decide which prior I assign to the regression coefficient $\bf{\beta}$ ? Is there a literature that discusses this?

• The short answer is "use Zellner's g-prior". It is described in our book, Bayesian Essentials. Jan 26, 2015 at 21:00

For example, if your variables are economic variables for individuals (e.g. unemployed, level of education, GDP of country of residence, age) you might take hints from economic theory for predicting, for example, annual income; at the very least, you would at least have guidance for the signs of the means of the components of the $\beta$ vector.
As for the variance, you would choose a higher variance for your prior if you're less sure about the effect of each component. You may also want to think about possible interaction effects between your variables (which would manifest in covariance between different $\beta_i$ coefficients). Here it could be beneficial to impose additional assumptions, such as constant variance or a diagonal covariance matrix for your $\beta$ prior, for computational simplicity.
At the end of the day it's kind of an art, but there are some cases for which you can obtain reasonable conjugate priors on $\beta$ if you assume, for example that $\beta$ has a multivariate Normal prior, and $\epsilon$ is also some flavour of multivariate normal.