# Questions tagged [gibbs]

The Gibbs sampler is a simple form of Markov Chain Monte Carlo simulation, widely used in Bayesian statistics, based on sampling from full conditional distributions for each variable or group of variables. The name comes from the method being first used on Gibbs random fields modeling of images by Geman and Geman (1984).

313 questions
Filter by
Sorted by
Tagged with
361 views

### which R package is good for gibbs sampler when the likelihood function is complex

I see a lot of examples using MCMC to solve for posterior distribution when the likelihood is simply one of linear regression. What if the likelihood is an ugly, complex function. Which R package can ...
84 views

### Gibbs Sampler Consistency

Simple question that I haven't found easily online: why are the estimates obtained from a Gibbs sampler consistent (converge to the true probabilities)?
380 views

716 views

### Gibbs Sampling for Gaussian Mixtures

Does the Gibbs sampler converge to a global maximum in the presence of multiple modes? For example in case of a Gaussian mixture distribution?
1k views

### Sampling covariance matrix using Gibbs sampling

I am sampling covariance matrix from a Inverse Wishart distribution. In one dimensional case, after doing sufficient iterations I am taking the mode value for variance (after removing the burn-in ...
111 views

357 views

### Sampling from the joint distribution p(x,y) when y = f(x)

Suppose I want to sample from the joint distribution $p(X, Y)$, where $X$ is a random variable and $Y = f(X)$ where $f$ is a known function of $X$. However, sampling from $p(X,Y)$ directly is hard. ...
446 views

### Why Gibbs sampling?

I am new to Gibbs sampling and sampling in general, so here is a basic question. I am reading this tutorial. Equation (40) is our complicated joint probability and equation (49) the less complicated ...
552 views

### How to do MC integration from gibbs sampling of posterior

I'm a beginner of MCMC. Two questions confused me. If I know the posterior distribution, and from the Gibbs sampling, I got the sampled parameter, so How to draw the histogram with y axis as ...
485 views

### Generating Sample Path of HMM via Gibbs Sampling

I have a question regarding section 7.1.1 here. I have two questions to ask you. What does the following sentence mean? we shall be drawing values for $C_T,C_{T-1},\cdots,C_1$ in order. How the ...
186 views

72 views

51 views

### Gibbs sampler -transformation of conditional posterior

If my conditional posterior $\pi(\sigma^{-2}|\mathbf{y },\mu)\sim Gamma(a,b)$, how can I get the conditional posterior $\pi(\sigma^{2}|\mathbf{y },\mu)$ with a transformation? The reason I ask is ...
26 views

797 views

### How to check the convergence in the collapsed Gibbs sampling of LDA? [closed]

I am trying to implement the LDA model fit by collapsed Gibbs sampling by myself. I have go through this article. And there is a clear pseudo code (section 5.5), ...
204 views

### How to sample random variables (x,y) from a bivariate Cauchy distribution using a Gibbs sampler?

A bivariate Cauchy distribution is equivalent to a bivariate t-distribution with 1 degree of freedom.
85 views

### How does one determine which variables can be collapsed in Gibbs Sampling?

I am going through the derivation for Gibbs Sampling update equations for LDA. The claim is that $\theta_{d}$ (document specific topic distribution) and $\phi_k$ the topic-word distribution can be ...