1
$\begingroup$

In Bayesian statistics I see this derivation often.

Given the likelihood function $f(X|\theta)$ and the prior $f( \theta |a, b)$, the author will derive $f(X|a,b)$. The steps in between are considered trivial but I cannot derive $f(X|a,b)$ myself.

Can anyone please provide some hints, perhaps how to "introduce" $\theta$ into $f(X|a,b)$?

Improve this question
$\endgroup$

1 Answer 1

Reset to default
1
$\begingroup$

If $\theta$ is discrete, then $$f(X|a,b) = \sum_{\theta\in\Theta} f(X|\theta)f(\theta|a,b)$$ and if $\theta$ is continuous (the usual case) then $$f(X|a,b) = \int_\Theta f(X|\theta) f(\theta|a,b) d\theta$$ where $\Theta$ is the support of $\theta$. The quantity $f(X|a,b)$ is usually called the prior predictive distribution.

Improve this answer
$\endgroup$
2
  • $\begingroup$ I see. And what you wrote is true because $f(X|\theta) = f(X|\theta, a, b)$, right? $\endgroup$
    – Heisenberg
    Commented Mar 31, 2014 at 1:53
  • $\begingroup$ Yes. That is correct. $\endgroup$
    – jaradniemi
    Commented Mar 31, 2014 at 18:39

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.