I have given a prior which has a range of data between[0.5,1.5] and a normal distribution N(0.9,1) which should truncate at the above range and normalize.

also I have the likelihood distribution in a form of errors distributed normally N(0,1)

when I try to write the likelihood function should I take the range [0.5,1.5] itself? or I should take the range from [0,inf]?


1 Answer 1


Direct answer: The likelihood as described in your second paragraph is defined on the whole of [-inf,inf], and that's the domain on which it should be.

Meta-answer: It doesn't matter for any practical inference purpose. Outside of [0.5,1.5], the likelihood will always be multiplied by the zero value of the prior, so you can assign the likelihood any set of values you like - Gaussian, zero, the square root of a giraffe - and it won't make any difference to your results.

Meta-meta-answer. That prior is a bad idea, for one philosophical reason and one practical reason. The philosophical reason is that that prior expresses the certainty that the value of the parameter is not outside [0.5,1.5]. But the prior represents what you believe before you've seen the evidence, and you should never express certainty of anything (or at least, anything logically contingent) before you've seen the evidence. (Unless, of course, that prior is actually the posterior from an inference process you've already done based on some previous data set.) The practical reason is that that prior has no gradient outside [0.5,1.5], which will make a lot of computational integration and optimization methods very (perhaps infinitely) inefficient.

  • $\begingroup$ Yes, The Likelihoods will be zero anyway outside [0.5,1.5] . So it is meaningful that you are saying you can take any range of values and compare results! secondly, the prior is given already and in this problem it is simple I think in away that it is simple and understandable for conceptual start of Bayesian inference! Thanks $\endgroup$
    – SHAMM
    Aug 28, 2020 at 20:46

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.