Questions tagged [dirichlet-process]

A family of stochastic processes whose realizations are probability distributions

Filter by
Sorted by
Tagged with
5
votes
2answers
523 views

Understanding the construction of Dirichlet process

I'm trying to understand the construction process of DP, however, with little background in measure theory, the original papers are hard to read, but I believe the ideas behind these papers can be ...
0
votes
3answers
1k views

Understanding the derivation of an equation in LDA modeling

When reading the derivation of LDA models, I usually get the following equations. I do not quite understand the second step, where $p(\mathbf{z}_{-i},\mathbf{w}|\alpha,\beta)$ was removed. Is that ...
5
votes
1answer
290 views

The case for non-parametric models

I am relatively new to non-parametric models, such as the Hierarchical Dirichlet Process, Pitman-Yor processes, etc. but I have read that non-parametric methods are data-driven, and that they can be ...
2
votes
2answers
499 views

Nonparametric Topic Models

I am confused between what types of problems these three models capture, and their applications: Latent Dirichlet Allocation (LDA) Dirichlet Processes and Pitman-Yor processes Hierarchical Dirichlet ...
11
votes
3answers
5k views

Multinomial-Dirichlet model with hyperprior distribution on the concentration parameters

I will try to describe the problem at hand as general as possible. I am modeling observations as a categorical distribution with a parameter probability vector theta. Then, I assume the parameter ...
8
votes
2answers
550 views

Dirichlet processes for supervised learning?

It seems when I glance around here at the fashionable learning algorithms, things like neural networks, boosted trees, support vector machines, random forests, and friends are promoted for supervised ...
5
votes
0answers
67 views

How to define and model consumption bundles?

Imagine an a la carte buffet with n different rooms. On entering the buffet you pick a room (let's say American, Mexican or Italian food) where you stay for the duration of your visit. Once in a room,...
8
votes
3answers
3k views

Mixture Models and Dirichlet Process Mixtures (beginner lectures or papers)

In the context of online clustering, I often find many papers talking about: "dirichlet process" and "finite/infinite mixture models". Given that I've never used or read about dirichlet process or ...
5
votes
1answer
6k views

Dirichlet process/Chinese restaurant process for clustering in R

I recently read a fascinating article describing methods for clustering data without assuming a fixed number of clusters. The article even includes some sample code, in a mix of Ruby, Python, and R. ...

1 2
3