Questions tagged [reversible-jump]

Reversible jump MCMC is a Markov chain Monte Carlo method designed to move between spaces of different dimensions while preserving the intended target distribution.

Filter by
Sorted by
Tagged with
4 votes
1 answer
2k views

Gibbs sampling with mixed prior using a Metropolis-Hastings step

My questions are about a sampling procedure for fitting a Bayesian hierarchical model where one of the priors is a mixture distribution of discrete and continuous parts. The model is not my own but I ...
Ray's user avatar
  • 479
3 votes
3 answers
1k views

A question about the choice and interpretation of the jumping distribution in Metropolis-Hastings algorithm

In order to implement the MH algorithm you need a proposal density or jumping distribution $q(⋅|⋅)$, from which it is easy to sample. If you want to sample from a distribution $f(⋅)$, the MH algorithm ...
Stéphanie C's user avatar
3 votes
1 answer
119 views

Reversible Jump for normal mixtures in R^d

I'm reading the article "Multivariate mixtures of normals with unknown number of components" (Dellaportas and Papageorgiou 2006). In this article they describe in great details how to ...
mariob6's user avatar
  • 540
2 votes
2 answers
105 views

Simple alternative to reversible jump for nested models?

Suppose that we have a model such that $p(y\mid k, \theta_1,\dots,\theta_{k_\text{max}})$ depends only on $k,\theta_1,\dots,\theta_k$. Hence, as $k$ assumes the values $1,\dots,k_\text{max}$, we have ...
Zen's user avatar
  • 24.2k
2 votes
1 answer
266 views

How to calculate the MH ratio in a birth-death Reversible Jump MCMC?

I know the formula and think I understand it, but I must be doing something wrong. Assume $J\sim po(\lambda)$ and $X_J=(U_1, \dots, U_J)$ and $U_i\sim U(0,w)$. Then I want to sample from the ...
svendvn's user avatar
  • 843
2 votes
1 answer
63 views

Reversible-jump MCMC and Poisson processes

Suppose we have a time interval $t \in [0, T]$ in which events occur as a Poisson process with some arbitrary time-dependent rate $\lambda(t)$. These events occur at times $Y=(Y_1, Y_2, \dotso, Y_M)$ ...
Jordan's user avatar
  • 31
1 vote
0 answers
132 views

Reversible-jump MCMC for knot selection

Let $\{Z(\boldsymbol s):\boldsymbol s\in\mathcal D\}$ denote the Gaussian spatial random field on a spatial domain $\mathcal D\subset\mathbb R^2$. Suppose that at $N$ locations, we have observations $\...
Remy's user avatar
  • 1,782
1 vote
0 answers
33 views

BMA and RJMCMC predictive performance

We have a family of statistical models, with parameter spaces of different dimensions, which we aggregated through standard Bayesian Model Averaging (BMA). Experiments using training and test sets ...
Zen's user avatar
  • 24.2k
0 votes
1 answer
72 views

Jacobian and proposal ratio of Birth/death step in RJMCMC of Gaussian mixture model

I am asking questions regarding RJMCMC several times in this site. Some of my questions are answered and some are unanswered. It didn't clarify all of my unclear points but I am glad that I have ...
Kyungmin's user avatar
0 votes
0 answers
189 views

Trying to understand Reversible Jump MCMC

As stated in the foundational Biometrika paper of Green (1995) 'Reversible Jump Monte Carlo Calculation and model discrimination' I am researching the inversion of the data in Geophysics and MCMC is ...
Kyungmin's user avatar
0 votes
0 answers
111 views

Model Comparison within Bayesian Gaussian Mixture Model framework

Suppose that we conduct a simulation study, and the model that generated the data is the following Gaussian Mixture Model. $$f(x)=\pi_{1}N(x;\mu_{1},\sigma_{1}^{2})+\pi_{2}N(x;\mu_{2},\sigma_{2}^{2})+\...
Fiodor1234's user avatar
  • 2,234