1
$\begingroup$

What are the main differences between approximate bayesian computation vs approximate bayesian inference?

Are they essentially the same?

Do they refer to the same of different family of models?

My initial understanding was that bayesian computataions refer to approaches that are used when the likelihood or analytic form of the formulation is intractable and that bayesian inference was for methods when the posterior is intractable?

Am I thinking this wrong?

Improve this question
$\endgroup$
1
  • $\begingroup$ Do you mean " that Bayesian inference was for methods when the posterior is tractable"? $\endgroup$
    – Xi'an
    Nov 18, 2019 at 5:42

1 Answer 1

Reset to default
1
$\begingroup$

Approximate Bayesian Computation (ABC) is a family of methods that can be used when likelihood is intractable.

Approximate Bayesian Inference seems to be used ambiguously, either as a synonym for ABC, or for Variational Inference, i.e. class of methods that given (trackable) likelihood and priors approximate the posterior distribution.

Neither of those have anything to do with having closed-form solution for posterior. If you don't, you can simply use Markov Chain Monte Carlo, or other approach to sampling from, or estimating the posterior.

Improve this answer
$\endgroup$
12
  • $\begingroup$ Thanks for the reply. I was under the impression that MCMC, VI & Laplace approximations belong to Approx. Bayesian Inference? Also ABC can be used when the density function is intractable? $\endgroup$
    – Kirk Walla
    Nov 17, 2019 at 22:42
  • 1
    $\begingroup$ @kirk I don't recall it being used like this. This would mean that Bayesian inference is approximate Bayesian inference, since there's almost nothing left beyond this. $\endgroup$
    – Tim ♦
    Nov 18, 2019 at 5:39
  • 1
    $\begingroup$ Contrary to ABC, VI, Laplace or EP, MCMC (like Monte Carlo) is not an approximate method in the sense that increasing the computing time increases the precision of the result. $\endgroup$
    – Xi'an
    Nov 18, 2019 at 5:41
  • $\begingroup$ @Xi'an & Tim, thank you folks for the help. My confusion is based on reading a thesis and a paper. The thesis talks about ABC and specifically that they're used when either the likelihood or density func. are intractable. On the other hand the paper has the following quote: "The posterior is intractable. 3 standard methods of approx. Bayes infer. exist: MCMC, VI, Laplace approx.". Is this statement wrong? $\endgroup$
    – Kirk Walla
    Nov 18, 2019 at 9:36
  • $\begingroup$ @kirk maybe you could share the source of the quote for some context? $\endgroup$
    – Tim ♦
    Nov 18, 2019 at 10:15

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.