# Questions tagged [dirichlet-process]

A family of stochastic processes whose realizations are probability distributions

127 questions
Filter by
Sorted by
Tagged with
29 views

### Estimating the likelihood of a Dirichlet process

I am not sure if what I'm trying to achieve makes sense or is even possible, but I'd like to do MLE on a Dirichlet process mixture model. My reasoning is the following: If we can write out the ...
• 273
13 views

### Can we use Dirichlet process to simultaneously estimate the number of mixtures and component distribution of a Bernoulli mixture?

Suppose I have a random sample on a Bernoulli random variable $\{X_i\}_{i=1}^N$ generated from model $p=\sum_{k=1}^K\pi_kp_k$,where $p\equiv Pr(X=1)$ and $p_k\equiv Pr(X=1|k)$, and $\pi_k$ are the ...
• 1,682
19 views

### Derivation of posterior distribution under Dirichlet prior distribution:

suppose that $\mathbf{y}=(y_1, y_2, \cdots, y_n)$ is a vector of $n$ observed sample points drawn from a mixture of $g$ components, and $\mathbf{z}=(z_1, z_2, \cdots, z_n)$ is a vector of latent ...
• 133
23 views

### Mixtures of Dirichlet multivariates or Dirichlet processes

I am exploring the properties of Dirichlet distributions and their parameters. When mixing two Dirichlet distributed random bivariates $$\mathbf{X}\equiv(X_1,X_2)\sim\text{Dir}(\alpha_1,\alpha_2)$$ ...
24 views

### Scoring rules for Dirichlet process mixtures

Let's say I do a sample-based fitting of a Dirichlet process model: \begin{aligned} X_i &\sim f(x_i\mid \theta_i)\\ \theta_i &\sim G\\ G &\sim \text{DP}(\alpha, G_0) \end{aligned} ...
• 173
113 views

• 1,700
159 views

### Why does Chinese Restaurant Table Distribution look like a Gaussian Distribution?

The Chinese Restaurant Table Distribution describes the probability distribution for the number of non-empty tables in the Chinese Restaurant Process after $T$ customers have been seated. Specifically,...
1 vote
140 views

### Validity of BIC for Dirichlet process mixture models

I am implementing clustering using Dirichlet process mixture models via scikit learn's Variational Bayesian Gaussian Mixture model. I arrived at the appropriate priors iteratively, and I am able to ...
• 63
144 views

• 221
187 views

### Clarifying Dirichlet Process Mixture Probability Terms

Suppose I have a Dirichlet Process Mixture model defined as follows: $\alpha \sim G(a,b)\\ \pi|\alpha \sim \text{Dir}(\alpha)\\ z|\pi \sim \text{Cat}(\pi)\\$ where $G$ is just a standard Gamma ...
• 380
1k views

### Coding a simple Stick-Breaking Process in Python

I've just red the great 2012 blog post of Edwin Chen about Dirichlet Process with companion code in R and Ruby. Then I'm trying to translate the Stick-Breaking Process from R to Python. I've got this ...
1 vote
292 views

### Gibbs sampler for Dirichlet Process concentration parameter

I am trying to implement a Gibbs sampler for Hierarchical Dirichlet process, but I cannot seem to correctly estimate the concentration parameters. I therefore started testing just this part of a ...
• 133
1 vote
67 views

### HDP: Gibbs sampler implementation

I am trying to recreate the model proposed by Gao et al. (2011), based on the Hierarchical Dirichlet Process proposed by Teh and al. (2005). To estimate the model (let's call it iHDP) I need to ...
• 133
1 vote
196 views

### Dirichlet-Multinomial Distribution with many zero counts

Short version: Is there someway to make the dirchlet-multinomial distribution sensitive to the presence of zero counts? Long version: I am attempting model metric positions in musical data. You can ...
• 131
1 vote
100 views

### How to interpret graphical model for Dirichlet process mixture for variational inference?

I am working through this paper by Blei and Jordan, which introduces variational inference for Dirichlet process mixtures. They derive an evidence lower bound (ELBO) function based on a stick breaking ...
• 885
73 views

### How to actually draw a distribution from a given Dirichlet process?

I am wondering if there's an algorithm to actually draw a distribution from a given Dirichlet process. The closest thing I've came across is the stick-breaking construction of a Dirichlet process, but ...
• 21
233 views

### Understanding Dirichlet Process Mixtures

I have been reading a ton of stuff online and have a question about my understanding of Dirichlet Process Mixtures. First some basics on what I understand: Dirichlet Distribution: multivariate ...
171 views

### Explanation of Formal Definition of Dirichlet Process

I am reading about the Dirichlet process and I can understand the construction from Chinese restaurant process or stick-breaking process or Polya urn scheme. Now I am trying to understand why ...
• 1,643
611 views

### Stick-breaking construction of Dirichlet process

In the stick-breaking construction of Dirichlet (let me base things on Sethuraman's construction - slide 6 of this) do we sample one $\phi$ vector from the base distribution $H$ and use it for ...
• 1,052
1 vote
96 views

### Why is the Dirichlet Process not a completely random measure?

A completely random measure assigns independent mass to nonintersecting subsets. I cannot figure, however, how the Dirichlet Process does not qualify as a CRM? Aren't the atoms all independent from ...
1 vote
140 views

### Dirichlet process and clustering

How does clustering with a Dirichlet process as prior work? I am confused as to if the parameter $\alpha_i$ $\sim$ DP is found via clustering or is used to cluster. I undestrand how it can be used to ...
• 11
1 vote
54 views

### Clustering and Dirichlet process' parameter

I am reading a paper in which they describe a bayesian model in which the prior $a_i$ is defined as a Dirichlet Process (DP). They say: "We use a DP to find the optimal $a_i$ via clustering". Later on ...
1 vote
26 views

### Q about closed form of distribution

Suppose you have a K boxes, each with associated probability $p_i$. You start putting balls in the boxes with probability of putting a ball in a box being proportional to $(n_i+1)\cdot p_i$ where $n_i$...
• 737
99 views

### Applications of Hierarchical Dirichlet Process to Continuous Data

I read Yee Whye Teh et al.'s paper on Hierarchical Dirichlet Process. In section 5, they show sampling algorithm using base distribution H and data distribution F. One of their applications is HDP-...
• 367
976 views

### Predictive Density for Dirichlet Multinomial

I am wondering what the predictive distribution of a Dirichlet-Multinomial distribution is. In this tutorial (page 24), the predictive density is simple and something like "pseudo samples." However, ...
• 638
1 vote
312 views

### Collapsed Gibbs sampler on Hierarchical Dirichlet Process Mixture Model

I am trying to design a collapsed Gibbs sampler on a mixture model based on Hierarchical Dirichlet Process ($g\sim DP(\gamma, b)$, $\pi\sim DP(\alpha, g)$ ). Should I resample from the posterior of ...
• 884