1
$\begingroup$

I am trying to code some importance sampling algorithms, but I have a question about how importance sampling works.

Say we want to estimate the expected value of some function $h(x)$, with samples drawn from the distribution defined by the pdf $\pi(x)$, which is hard to sample, so we have the proposal distribution defined by the pdf $g(x)$. When does this algorithm work better, when $g(x)$ is similar to $\pi(x)$ or similar to $|h(x)|\pi(x)$?

$\endgroup$
1
  • 2
    $\begingroup$ Have you taken a look at the expression for the asymptotic variance? $\endgroup$
    – Taylor
    Commented Feb 13, 2020 at 2:58

1 Answer 1

1
$\begingroup$

The most relevant result in that area is that the choice of $g$ that leads to the minimal variance is$$g^\star(x) = \dfrac{|h(x)\pi(x)|}{\int_\mathfrak X }$$

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.