Bayesian prior corresponding to penalized regression coefficients I'm working on a Bayesian Regression problem where I would like to estimate the beta coefficients subject to this constraint (penalty):
$\sum|\beta_i|<C$ or similarly $\sum \beta_i^2<C$
Which is basically a Lasso or L2 Penalty.
Now, if I understand correctly, we constrain the coefficients through the prior in Bayesian analysis.  Therefore my question is what would an appropriate prior be for the Betas?  I should note, that for my case, the betas are restricted to be positive, they cannot be negative.
 A: L2 penalty penalizes the sum of squared betas but not via a constraint such as $< C$.  The L1 penalty is the lasso.  For the Bayesian lasso see the 2008 JASA paper by Trevor Park and George Cassella.
A: For the lasso penalty this corresponds to a double exponential prior - so long as you are taking the posterior mode as your estimate.  If you constraint the betas to be positive then you have an exponential prior.  The parameter of the exponential distribution $\lambda$ has a correspondence with your $C$ in that you can choose a value of each such that the same naximum is achieved.  The bayesian prior is the langrangian form (on log scale) of the constraint.  For the ridge penalty constraning the parameter to be positive is just a truncated normal distribution.
A: The $L_2$ constraint on the coefficients is Tikhonov regularization.  
It turns out that for the case where the prior is multivariate normal and the model is linear, the posterior is also multivariate normal.  It turns out that the mean of the posterior distribution occurs at a point in parameter space that can also be obtained by  Tikhonov regularization and the relationship between the Tikhonov regularization parameter and the equivalent multivariate normal prior is pretty simple.  
This is textbook material that can be found in Tarantola's textbook among other places.  
When the model being fit is nonlinear, or there are additional constraints on the parameters (such as your nonnegativity constraint), or the prior isn't MVN, it all becomes much more complicated and this simple equivalence breaks down.   
A: If you want your $\beta$s to be non-negative and sum to a given value then it seems a scaled Dirichlet prior would make sense.
