Questions tagged [infinite-mixture-model]

Filter by
Sorted by
Tagged with
1
vote
0answers
17 views

Mixture or Convolution

tl;dr is final paragraph at the bottom. I have read the posts explaining the differences between mixture distributions and convolutions of distributions, but am having a hard time understanding which ...
0
votes
0answers
10 views

Convolutional roots of mixture of exponential distributions

In the reference book on infinite divisibility and generalised gamma convolution, BONDESSON, Lennart. Generalized gamma convolutions and related classes of distributions and densities. Springer ...
0
votes
0answers
4 views

Dirchlet Process Mixture of Multinomials

The Dirichlet Process Mixture of Gaussians has been well studied and shown to work. I have never seen DPM of Multinomials and tried to implement one. What I notice is the likelihood tends to dominate ...
0
votes
0answers
19 views

Dirichlet Process mixture model with independent features

I'm trying to construct a Dirichlet process mixture model for clustering where the samples have independent features. In other words, to evaluate the likelihood of sample $x_i$, I would compute $\...
1
vote
1answer
55 views

Bayesian Inference: Prior in Chinese Restaurant Process

For the Chinese restaurant process, as used in Dirichlet Process mixture models, we have a prior that data point i belongs to cluster j, where c is an indicator. n represents the total number of data ...
2
votes
1answer
109 views

Clarifying Dirichlet Process Mixture Probability Terms

Suppose I have a Dirichlet Process Mixture model defined as follows: $\alpha \sim G(a,b)\\ \pi|\alpha \sim \text{Dir}(\alpha)\\ z|\pi \sim \text{Cat}(\pi)\\ $ where $G$ is just a standard Gamma ...
2
votes
0answers
42 views

Any connections between mixed model and mixture of experts model?

Given data $<y_i, X_i>$ for $i \in \{1, 2, 3, \dots n\}$ ($n$ samples), and we are interested in knowning the relationship between $y$ and $X$. In the simplest manner, we can solve for $\beta$ ...
2
votes
0answers
33 views

Estimation of arbitrary density on the real line with infinte Gaussian mixtures

In his Introduction to this paper, Ferguson says that we can model an arbitrary density f(x) on the real line as the mixture of a countable number of normal distributions in the form: $f(x) = \sum_1^{...
3
votes
1answer
283 views

Check on intuition behind infinite mixture models for clustering

I'm trying to better understand the intuition and practical application of infinite mixture models (Dirichlet Process) and finite mixture models. For example, say I have a data set on which I run a ...