Questions tagged [gibbs]

The Gibbs sampler is a simple form of Markov Chain Monte Carlo simulation, widely used in Bayesian statistics, based on sampling from full conditional distributions for each variable or group of variables. The name comes from the method being first used on Gibbs random fields modeling of images by Geman and Geman (1984).

340 questions
Filter by
Sorted by
Tagged with
25 views

Does MCMC Gibbs sampling algorithm first build a steady Markov Chain, then does the sampling to build the posterior distribution?

I am currently studying MCMC Gibbs sampling and while reading this part, a question has come into my head if MCMC Gibbs sampling first build a steady Markov Chain and does the sampling or does ...
25 views

Gibbs sampling for simple posterior distribution?

I have a likelihood function, $$p(x) = \theta^{\sum x} (1- \theta)^{n-\sum x}$$ and prior distribution, $$p(\theta) \propto \theta^{\alpha - 1} (1- \theta)^{\beta - 1}$$ then the posterior ...
7 views

Belief Propagation vs Gibbs Sampling

In general what are the cons and pros of using Gibbs sampling to estimate a complex posterior (assuming we can sample from the conditionals) over belief propagation (using a factor graph)?
17 views

sampling question in Gibbs sampling for a Gaussian mixture model

I have some confusions regarding the Gibbs sampling step for the following mixture model: consider a mixture model of the following generative process: $\theta \sim Dir(\alpha)$ (global hidden ...
19 views

21 views

Gibb's sampling where target prob distribution is itself a conditional joint distribution - p(x,y|t)

I'm new to Gibb's sampling and need basic guidance. Say p1,p2,q-> are Gaussian variables. p1->q<-p2 and q->x where x is a discrete variable (either 1 or 0). How do I go about Sampling (using ...
34 views

27 views

25 views

Conjugate prior for DPGMMs using Gibbs sampling

I am using Gibbs sampling to infer DPGMMs. The prior for multivariate Gaussians is Normal-inverse Wishart. But it turns out that the covariances are not estimated accurately. Here is codes and results....
25 views

precision or variance of a Gamma distribution in a Gibbs Sampler?

I want to confirm my thinking on a quick question I have regarding the Normal-Gamma Gibbs sampler that we see so often, but I am unable to find a satisfactory answer. If we are interested in ...
25 views

195 views

Proper likelihood function in acceptance probability of Gibbs Sampler

I have a question about the acceptance ratio used when implementing a random walk M-H in a gibbs sampler to generate sample paths of an unobservable process. When computing the likelihood of a set of ...
665 views

How can I sample from the conditional distribution?

I am learning Gibbs Sampling, in which there is a step named sampling from conditional distributions. I don't understand: 1. where is the conditional distribution from? From a general case, how can I ...
104 views

How to sample via blocked Gibbs the conjugate normal model?

i am trying to sample the two dimensional parameter $\theta=(\mu,\sigma^2)$, for the Normal model. I have the full conditionals being for the mean: \$\pi(\mu_{j}|\ldots) \sim N\left(\frac{\xi_{j}\...