I am wondering how to get rigorously from Bayes rule to maximum a posteriori estimation (MAP)? I have searched the web, but everything I find is very unclear.

Would someone explain, whether or not this can be done rigorously or alternatively please suggest some good books or papers that address this question?

  • $\begingroup$ I'm voting to close this question as off-topic because the question just requests references. Could also say it is opinion-based. $\endgroup$ – Michael Chernick Jan 1 '18 at 19:00
  • 2
    $\begingroup$ @MichaelChernick reference requests are not off-topic, we even have the references tag for such questions. $\endgroup$ – Tim Jan 1 '18 at 20:07
  • $\begingroup$ @Tim You can always cite questions that violate current rules. References can be part of the topic of a question without being the full answer. I know that I answered questions about statistical references say 5 years ago but that doesn't mean the rules did not change. I think that if the question is strictly about references it is or should be off topic. $\endgroup$ – Michael Chernick Jan 1 '18 at 20:55
  • 2
    $\begingroup$ @Michael The record indicates this community disagrees with you. See stats.meta.stackexchange.com/questions/950 for the original discussion, stats.meta.stackexchange.com/questions/4748 for the most recent, and also refer to related threads at stats.meta.stackexchange.com/questions/2471 and stats.meta.stackexchange.com/questions/2428. $\endgroup$ – whuber Jan 1 '18 at 23:31
  • 1
    $\begingroup$ @MichaelChernick The question had some problems of syntax, English, punctuation, order of ideas, bad terminology, logic, etc. Perhaps that was what was bothering you, so I fixed it. Having done that I would only remark that this question may have been broached before stats.stackexchange.com/questions/73313/… $\endgroup$ – Carl Jan 2 '18 at 5:00

[This is an entry I wrote on my blog when the paper by Basset & Deride appeared.]

Robert Bassett and Julio Deride arXived a paper last year discussing the position of MAPs within Bayesian decision theory. A point I have discussed extensively on my blog.

“…we provide a counterexample to the commonly accepted notion of MAP estimators as a limit of Bayes estimators having 0-1 loss.”

The authors mention my book The Bayesian Choice stating this property without further precautions and I completely agree to being careless in this regard! The difficulty stands with the limit of the maximisers being not necessarily the maximiser of the limit. The paper includes an example to this effect, with a prior as above, associated with a sampling distribution that does not depend on the parameter. The sufficient conditions proposed therein are that the posterior density is almost surely proper or quasi-concave.

This is a neat mathematical characterisation that cleans this “folk theorem” about MAP estimators. And for which the authors are to be congratulated! However, I am not very excited by the limiting property, whether it holds or not, as I have difficulties conceiving the use of a sequence of losses in a mildly realistic case. I rather prefer the alternate characterisation of MAP estimators by Burger and Lucka as proper Bayes estimators under another type of loss function, albeit a rather artificial one.


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.