The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [mixture]

A mixture distribution is one that is written as a convex combination of other distributions.

Filter by
Sorted by
Tagged with
0
votes
0answers
5 views

Mixture Densities weights

I'm supposed to find the mixture weights and densities of all the mixture components. Should i find the normalizing constant in this case then work from there? Any hints or solutions will be much ...
0
votes
0answers
9 views

Is the Mixture model just one type of Latent variable model?

Is the Mixture model just one type of Latent variable model? If not, then what is the relationship between Mixture models and Latent variable models?
0
votes
1answer
51 views

Why is weighing random observations according to their probability from all distributions wrong?

Is sampling all distributions n times and then talking out i numbers from each sample, where i is probability of that distribution * n, wrong? Suppose $$ 0.3\!\times\mathcal{N}(0,1)\; + \;0.5\!\...
0
votes
0answers
21 views

Random Samples from Spliced Distribution

I am studying Clauset, Shalizi, and Newman, Power Law Distributions in Empirical Data (preprint available here) in R. Packages used: ...
0
votes
0answers
20 views

Modelling a random variable that is mostly zero, but otherwise exponential (PyMC3)

I'm new to probabilistic programming, and have run into problems of this kind a few times now. Simply put: I often find myself wanting to model a random variable that mostly has some nice, continuous ...
1
vote
0answers
8 views

Convergence of empirical quantiles to theoretical quantiles - mixed type distribution

It is well known that under certain (not too restrictive) conditions empirical quantiles of a distribution converge to the corresponding theoretical quantiles in probability as the sample size $n \to \...
1
vote
0answers
17 views

Variance analysis for state dependent mixture importance sampling estimators

Let $(E,\mathcal E,\lambda)$ be a measure space $k\in\mathbb N$ $q_i:E\to[0,\infty)$ be $\mathcal E$-measurable with $$\int q_i\:{\rm d}\lambda=1$$ and $\nu_i:=q_i\lambda$ for $i\in\{1,\ldots,k\}$ $...
0
votes
1answer
42 views

Clusters keep switching in Gibbs sampling of Dirichlet Process Mixture Model

All the code and data for this question is on GitHub (stackexchange.R script). I've got multivariate Bernoulli data that I'd like to analyse using Bayesian Mixture ...
4
votes
1answer
71 views

How to latently cluster regressors based on regressors' relationship with the outcome?

What is the best way/method to model patterns across coefficients and reduce number of coefficients based on these patterns? We have hundreds of regressors on the same scale and try to reduce the ...
0
votes
0answers
17 views

Significance of modes in a distribution

I have several datasets with angular measurements, i.e. circular values from 0 to $2\pi$. These datasets tend to have peaks at 0 and/or $\pi$, and I need to tell if the peaks are detected/significant. ...
0
votes
1answer
28 views

Estimating two-component mixture of Weibull distributions?

Is there any existing package (preferably in Python or Matlab) to estimate the parameters of a two-component Weibull mixture model? And failing that, I am hoping to get some pointers towards rolling ...
0
votes
0answers
13 views

Predication of MDN

How to get the prediction of Mixture Density Networks? In MDN one models the conditional density: $P(y^i |x^i) = \sum_{j=1}^{m} \alpha_j(x^i)\phi({y^i|x^j})$, so I guess one just sample from the ...
0
votes
0answers
40 views

latent variables in EM algorithm are assumed to be i.i.d from multinomial distribution, from what they are idependent

In EM algorithm we introduce a latent variables, say $z_i$, $i=1,...n$, $n$ is the number of the mixture component. These variables ($z_i$) are assumed to be independent and identically distributed ...
2
votes
1answer
60 views

How to find quantiles and likelihoods of mixture distributions?

My PDF: M was estimated and found to be 5. I need to work out the quartiles for the PDF above. In addition, I need to use different methods of estimation to estimate the parameters. So far I've ...
0
votes
0answers
19 views

How is jaccard similarity used to find the similarity between Bootstrap samples when measuring stability of EM?

Im reading the answer on "how to determine number of clusters in EM algorithm". How to tell if data is "clustered" enough for clustering algorithms to produce meaningful results? One of the ...
0
votes
0answers
18 views

Closed form posterior for product of inverse Gamma and Normal distribution

I am currently reading a book about mixture analysis, and in the textbook a posterior for the parameters $\mu1,\mu2,\sigma_1^2,\sigma_2^2$ of a two-component gaussian mixture is derived as follows (S ...
0
votes
0answers
20 views

Can mixture model used as classification prediction

I am learning a prediction model in statistic. I read that we can used mixture model as a classification. My question is, assume we have a data which can be divided into two groups. Can we in this ...
0
votes
0answers
681 views

Joint posterior for finite mixture with normal components

I currently read the book Finite Mixture and Markov Switching Models by Sylvia Frühwirth-Schnatter and I have a question regarding Section 6.2.1 regarding finite mixtures with normal components. Maybe ...
0
votes
1answer
19 views

What does it means for “fit a less parsimonious model” in a clustering algorithm?

I'm now trying to implement the algorithm presented in https://www.stat.washington.edu/raftery/Research/PDF/fraley2005.pdf. The algorithm is the following one: First I get a mixture model for ...
3
votes
0answers
43 views

Concentration inequality for mean of Gaussian mixture

Say I have i.i.d. samples $X_1, \ldots, X_n \sim p \mathcal{N}(\mu_1, \sigma^2) + (1 - p) \mathcal{N}(\mu_2, \sigma^2)$. Then suppose I estimate the mean with the sample mean $$ \widehat{\mu} = \frac{...
1
vote
1answer
19 views

How to design Mixture of Experts where we want only one active model at a time?

I'm trying to design a Mixture of Experts where we want only one active neural network at a time. Suppose that we have 10 experts. I want to train a MoE such that only one of the experts is active ...
0
votes
0answers
4 views

Ideas for fixing manual misclassification

Imagine the following problem. Mechanics fix cars and use a set of parts which is recorded on invoices. They also write down a classification of the work that was done from a fixed set of possible ...
1
vote
1answer
124 views

Posterior Weights for Normal-Normal (known variance) model

So I have a mixture prior of: $p(\mu) = \pi p_0(\mu \mid \mu_0, \sigma^2_0) + (1-\pi) p_1(\mu \mid \mu_1, \sigma^2_1)$ and a likelihood of $$p(y\mid\mu) = (2\pi\sigma^2)^{-n/2} \exp\left(\frac{-1}{...
2
votes
1answer
39 views

Mixture of Poissons for positive and negative integers

I'm trying to design a generative model for a random variable $k\in\mathbb{Z}$. The model would work as follows. First draw $b\sim\text{Bernoulli}(p)$. If $b=1$, draw $k\sim\text{Poisson}(c)$. ...
0
votes
0answers
8 views

consistency of non-linear squares estimators in Gaussian mixture model

Does any one know or have references for the consistency of non-linear squares estimators in Gaussian mixture model? (or the consistency of qausi mles in Gaussian mixture model). Thank you. I have ...
0
votes
1answer
27 views

Binomial distribution for randomly drawn probabilities

Setting Probability theory can be a weird place sometimes. Here I was, confident in my insane math skills, trying to solve the following problem: Let $N, \alpha$ and $\beta$ be given. ...
0
votes
0answers
17 views

AIC influences by the number of the model parameters

From the different published paper about mixture models, I found that AIC is affected by the number of model components. That is due to the plenty term in ...
0
votes
0answers
12 views

Identification of mixture models with location shift

I am studying identification of mixture models of the type $$ F(x)=\sum_{j=1}^J \lambda_j G(x-\mu_j) $$ with $F,G$ denoting univariate CDFs, $G$ symmetric about $0$, $\mu_1<\mu_2<...<\mu_J$, $...
3
votes
1answer
27 views

Is it acceptable in mathematical saying that the E-step is equal to posterior probability

I am studying EM-algorithm for mixture data. I read that some authors said that, the E-step is equivalent to the calculation of the posterior probability (I think this come from Bayesian rule). So, my ...
0
votes
1answer
58 views

Point mass at zero and a chi square distribution with one degree of freedom

I am unclear about the critical value of a point mass at zero and a chi square distribution with one degree of freedom. How to find this?
0
votes
1answer
21 views

Equivalent way of rewriting a two-component mixture

I'm confused on the following equivalent way of rewriting a two-component mixture. Consider the two-component conditional mixture $$ F(z|x)=\lambda F_1(z|x)+(1-\lambda)F_2(z|x) $$ where all the $F$'...
0
votes
1answer
202 views

Simulate from a mixture of two beta distribution [closed]

I have this distribution : $X \sim 0.75\mathcal{B}e(\alpha_{X_1}=1,\beta_{X_1}=3)+0.25\mathcal{B}e(\alpha_{X_2}=5,\beta_{X_2}=1.75)$ where the density function is given from this function: ...
1
vote
0answers
26 views

A 2 component mixture is symmetric if and only if $\lambda\in \{0,1,\frac{1}{2}\}$

Consider the following mixture of two densities $$ f(x)=\lambda g(x-\mu_1)+(1-\lambda)g(x-\mu_2) $$ with $\lambda\in [0,1]$, $g(\cdot)$ symmetric around zero, $\mu_1<\mu_2$. Claim: the mixture is ...
0
votes
0answers
15 views

What is the different between the set of all model parameters and the parameter vector of the nth component

I read many articles about mixture models. I read that the author called the model parameters as "a set of all model parameters", while they said "parameter vector for the n-th component". I wonder ...
0
votes
0answers
27 views

Mixture of $K$ components

Consider a random vector $$ X\equiv \begin{pmatrix} X_1\\ X_2\\ X_3 \end{pmatrix} $$ with pdf $$f(x)=\overbrace{\sum_{k=1}^ K \frac{1}{K} f_k(x)}^{\text{finite mixture}}$$ and $\forall k=1,...,K$ $...
0
votes
1answer
41 views

Mixture of two components

Consider a univariate probability density function $p(x)$ that is a mixture of $2$ probability density functions with weights $\eta, 1-\eta$ and $\eta\in (0,1)$: $$ p(x)=(1-\eta)g(x)+\eta f(x) \...
1
vote
1answer
49 views

Calculating the probability that an observation comes from either population A or B

If I have two normal distributions A (mean = 0, variance = 4) and B (mean = 0, variance = 16), how can I calculate the probability that an observation with magnitude 2 comes from A?
4
votes
1answer
423 views

Why we do not accept the result of our simulation study as evidence of a limitation of one method

I am doing a mixture model. I have established a new method using EM-algorithm. I have simulated data from a mixture model. Then, I applied my new method to the data. The result is very satisfying. ...
1
vote
4answers
79 views

How to build a Bayesian Model to estimate the probability distribution of the parameters given the output?

I'm currently facing a new type of problem, and i have no idea how to solve it, so any suggestion will be really appreciated ! The problem is the following: I have a matrix of temperatures, depending ...
0
votes
0answers
9 views

Typo in the definition of Finite Mixed Model in Machine Learning a probabilistic Perspective

In subsection 25.2.1 it's stated, regarding finite mixture model: The usual representation (of a finite mixture model) is as follows: $p(x_i|z_i = k, \boldsymbol\theta) = p(x_i|\boldsymbol\...
0
votes
0answers
24 views

Fitting wrong copula type to a real data set

I have developed a new mixture copula model. This model overcomes some limitation of copula models. I tested my new model on a simulation data. The model shows a superior result. My supervisor asked ...
0
votes
1answer
217 views

Inferring GMM parameters with Gibbs Sampling

On my book, "Machine Learning A Probabilistic Approach". It's stated that is straightforward to derive a Gibbs sampling algorithm to fit a mixture model, especially if we use conjugate priors. So ...
2
votes
0answers
36 views

Understanding short animation about Dirichlet Process Mixture Model

On the wikipedia page of Dirichlet Process, there is the following video. I don't get the point of the video. My first impression was that the video was showing the fitting of one-dimensional data ...
3
votes
2answers
57 views

Confusion in modelling finite mixture model

From the book "Machine Learning a probabilistic Perspective", I'm reading about finite/infinite mixture models. Particularly at paragraph 25.2.1 it's stated: The usual representation (of a finite ...
1
vote
1answer
138 views

Why is variational Bayesian mixture model an alternative to MCMC? What are the similarities?

Why do people say that a variational Bayesian mixture model could be an alternative to MCMC for clustering? For example see the details here: https://en.wikipedia.org/wiki/Variational_Bayesian_method. ...
0
votes
2answers
71 views

Deriving a distribution whose pdf has the shape of a square + a triangle (a right trapezoid)

I want to the derive the PDF which looks like the sum of a triangular and uniform distribution which looks like this: To do this I have simply added the PDFs for the rectangular and triangular parts, ...
0
votes
0answers
10 views

Finitely parametrizable family of univariate distributions closed under mixing

Keilson and Steutel 1972 discusses several families of characteristic functions closed under mixing, such as the even positive characteristic functions log-convex on $\Bbb R^+$. I'm interesting in a ...
1
vote
0answers
118 views

How to implement Exponential Power distribution in JAGS

I would like to fit a simulated data to Exponential Power likelihood using uniform mixture with gamma mixing presented in "Scale Mixtures Distributions In Statistical Modelling" by Choy and Chan: $EP(...
1
vote
1answer
163 views

Why does not the weighted sum of gamma distribution come from weighted gamma variables?

If $Z\sim 0.3\Gamma(\alpha _1,\beta _1)+0.7\Gamma (\alpha _2,\beta_2)$, why isn't $Z=0.3X_1+0.7X_2$? $X_1\sim\Gamma(\alpha _1,\beta _1)$ and $X_2\sim\Gamma(\alpha _2,\beta _2)$?
1
vote
0answers
16 views

Does mixture of sigmoids make sense given the theories about mixture of bernoullis?

Mixture of bernoullis is the combination of bernoulli distributions, which can be illustrated by the sampling process of K bags of D coins, here is a quick tutorial about it https://cedar.buffalo.edu/~...