Questions tagged [model-based-clustering]
The model-based-clustering tag has no usage guidance.
65
questions
0
votes
0
answers
11
views
Understanding assumptions of equivalence of random effects variances; what to do when violated?
The random effects model is stated as:
$Y_{ij} = \mu + \tau_i+\epsilon_{ij}$
Where,
$\tau_i \overset{iid}{\sim} \mathcal{N} (0, \sigma^2_{\mu} ) \\ $
$\epsilon_{ij} \overset{iid}{\sim} \mathcal{N} (0, ...
0
votes
0
answers
72
views
Expectation Maximization on Multivariate Gaussian Mixture Model for clustering
I have a dataset with 1000 observations and two features that define those N=1000 data points. Hence it is 1000*2 input matrix. I need to cluster them into k clusters.
I am not understanding the E-M ...
- 1
0
votes
0
answers
5
views
Criterion to assign individuals to clusters in bayesian mixed model with distribution of probabilities
I have a dataset with a set of individuals indexed by $i = \{ 1, ..., N \}$, and I make a number of measuremenets under two conditions for each individual to measure the effect $\beta$ of my ...
- 1,168
1
vote
1
answer
28
views
Cluster uncertainty in Linear Regression
Is it possible to introduce cluster probabilities into a regression?
Consider the Old Faithful Geyser data set. Most clustering algorithms find 2 clusters when analysing eruption times and waiting ...
- 57
2
votes
1
answer
77
views
PCA : how to cluster data to differenciate my data the most while considering their groups
I have to do a PCA in R for a project, but I have 300 data in 15 differents groups, and I want to find the reduced space which gives me the most variability between the groups and cluster my data in ...
- 21
0
votes
1
answer
100
views
Model based clustering equivalent to K means?
Is it OK to say something like this: "A model-based clustering with a hard threshold is equivalent to a k means clustering"? One of my instructors stated this in his slides, I kind of doubt ...
- 85
1
vote
0
answers
35
views
Loss function definiton for relabelling
Taken from the appendix to the paper (Yongning Wang & Ruey S. Tsay) of this (2019) paper Clustering Multiple Time Series with Structural Breaks. Appendix to be downloaded her Appendix
To fix label ...
1
vote
0
answers
115
views
K-Means clustering technique for monthly data
I have an Unsupervised problem where user's Credit Card payment data is given for each month for various users for one year. One of the feature in the data having "User Id". For most of the ...
0
votes
0
answers
498
views
EM algorithm for multivariate gaussian with diagonal covariance matrix
Ok so quick question.
Say I need to use the EM-algorithm to estimate the parameters of a multivariate gaussian
$$
f_{k}\left(x ; \theta_{k}\right)=\frac{1}{(2 \pi)^{P / 2}|V|} \exp \left(-\frac{1}{2}\...
- 93
1
vote
0
answers
34
views
Which type of cluster analysis to perform?
I am trying to explain variability in the outcome, and understand factors that may be associated with different clusters? I am confused as to which clustering method to use to obtain 3 clusters as ...
- 11
1
vote
0
answers
93
views
Do Gaussian Mixture Models monotonically decrease the sum of squared distances when number of clusters increases?
I am comparing the clustering performance of two closely related machine learning methods: K-means and Gaussian Mixture Models (GMM). Part of this research is selecting the best number of clusters K. ...
- 21
1
vote
0
answers
430
views
Understanding and implementing the last step in the 3-Step Latent Class Analysis using covariates from Vermunt 2010
I am interested in implementing the 3-Step approach for LCA with covariates ($Z_i$) in R. According to Vermunt (2010), the "Standard" three-step approach would involve (mentioned in pages 5 ...
- 81
0
votes
0
answers
43
views
How to make inference on cluster-specific parameters in a Bayesian mixture model
Suppose I have a mixture model, for example of the kind
$$
y_i \mid w, \{\theta_h\}, H \sim \sum_{h=1}^H w_h f(y_i \mid \theta_h) \\
P(H=h) = q_h \\
w \mid H \sim Dirichlet(\alpha) \\
\theta_1, \ldots,...
- 540
1
vote
0
answers
548
views
Identifying inflexion point in elbow method (cluster analysis)
I am looking for the optimal number of clusters to conduct a cluster analysis and used the following code to determine it:
...
- 377
0
votes
0
answers
177
views
Clustering Highly Skewed and Segmented Data
So I am trying to cluster a dataset that looks like the following:
I have tried K-Means and GMM, which give me horrible results. I have tried DBSCAN, which was okay, but it is difficult to choose the ...
- 111
4
votes
0
answers
632
views
Can clustering with Gaussian mixture models be done based on cosine similarity?
Apologies if this has already been answered; I found some similar posts (here and here) but don't feel they answered the specific question I have. Please feel free to correct any misunderstandings in ...
- 41
1
vote
2
answers
2k
views
What is the interpretation of the weights in the GMM?
GMM is $p(x|\theta) = w_1 \mathcal{N}(x|\mu_1,\,\sigma_1^{2})\ + w_2 \mathcal{N}(x|\mu_2,\,\sigma_2^{2}) + w_3 \mathcal{N}(x|\mu_3,\,\sigma_3^{2})\,$
What is the interpretation of the weights here?
Do ...
- 1,360
0
votes
2
answers
33
views
Looking for clues on a possible method or approach for clustering particle data in the form of pulse shapes
I'm a biologist by origin, and I'm asking this question to the math community to learn from the vast knowledge that I don't posses myself but is out there in the math field.
Edit: This question was ...
- 101
0
votes
1
answer
31
views
Clustering Algorithm for for Different types of dimension
I want to cluster radar data but using its position (x,y) and its radial velocity. As position parameters have same units (meter) but radial velocity is in m/s. Which algorithm can be used for such ...
- 113
0
votes
0
answers
18
views
Multi variable clustering cartographical data
Firstly , my knowledge in statistics is very limited , so excuse me if I'm ask a none well placed question.
I have a country ,( example : USA ) , and i have 3 set of data
1) position (lat , lng ) ...
- 101
3
votes
1
answer
147
views
Multivariate mixture models
I am new to mixture modeling and have successfully used bernoulli mixture models to cluster datasets of binary data.
My real purpose, though is to cluster datasets with mixed data types: normal, ...
- 978
1
vote
0
answers
160
views
Clustering of temperature and precipitation courses. Searching for approach
I would like to cluster not only single observations, but I would like to cluster all observations for temperature together as a temperature course. So the goal is to cluster the temperature courses.
...
- 33
1
vote
1
answer
142
views
How to explore high dimensional data to inform a choice of clustering method?
I want to cluster users of a web app based on their engagement, my data looks approximately like:
id | count of action 1 | count of action 2 | ... | count of action n
I have 40 different counts and ...
- 133
0
votes
0
answers
600
views
In cluster analysis, how to determine if a variable has impact on the clustering process?
I am using model-based clustering to split a sample into 4 clusters, and would like to know if gender is a determining factor for the clustering of this sample.
My attempt was to compute the in-...
- 13
2
votes
0
answers
32
views
Community Detection for Complete Weighted Network [duplicate]
I am wondering if someone who has experience in trying to perform community detection algorithm with complete graph with weighted network.
As weighted networks represents the similarity of each node ...
- 21
4
votes
1
answer
729
views
Mclust: Data frame order affects solution
I've come across some behavior in mclust::Mclust that I would not have expected, which is that the order of variables in the data passed to ...
- 41
0
votes
1
answer
496
views
Multiple correspondence analysis for clustering (unsupervised learning) [closed]
I have limited stat/coding knowledge yet I try to do user clustering using unsupervised method using R.
I have about 2795 observations gained from survey (mixture of categorical and scale questions).
...
- 123
3
votes
0
answers
167
views
Mixture probabilistic model on mixed data
When dealing with homogeneous types of data, we can employ mixtures of gaussians (for continous) or some kind of k-proptotyping (ordinal-nominal).
I am investigating around the statistical/machine ...
1
vote
2
answers
2k
views
Fit indices using MCLUST latent cluster analysis
I conducted latent class/cluster analysis in R using the package MCLUST. I have a revise and resubmit for my paper, and the reviewer suggested making a table of the fit indices for the cluster ...
- 11
0
votes
1
answer
200
views
Merging the results of soft-clustering algorithm
The established soft-clustering algorithms like Fuzzy-k-means (Wikipedia), Gustafson-Kessel, Gath-Geva for point wise data or the funclust algorithm in functional data context are random-operating ...
- 31
1
vote
1
answer
793
views
Clustering unrelated (with no correlation) data
The objective of clustering analysis is to group data with similar characteristics in clusters, but in this case, I want to find the most unrelated data to group into clusters. In my particular case, ...
- 11
13
votes
1
answer
11k
views
Mclust model selection
The R package mclust uses BIC as a criteria for cluster model selection. From my understanding, a model with the lowest BIC should be selected over other models (if ...
- 2,290
0
votes
2
answers
1k
views
Problem in a cluster analysis of User behavior
Data set that extracted from Log file, the simplest way to represent it is by use User- Page view matrix which represent each user how many time visit corresponding page as attached in sample image,
...
- 19
1
vote
1
answer
59
views
How to differentiate two distinct linear populations with clustering in R
I am new to clustering. My apology if this has been asked before.
I'd like to differentiate two distinct linear populations within sample matrix, and tag them differently. Apparently k-means couldn'...
- 11
1
vote
0
answers
54
views
Stability of clusters/mixtures from GMMs
Some background
I have a data set with around 2000 samples and 16 features. Me and my colleague are trying out different methods for clustering and currently we are converging to the usage of a ...
- 3,681
1
vote
1
answer
624
views
Best Clustering Technique for Probability Scores
I have a data which which have 17 variables i.e. 17-Dimension data. The Data is a result of Max-Diff exercise which is performed for ranking these 17 attributes and have comparative preference/...
1
vote
3
answers
2k
views
Clustering of distributions in R
I have a set of distributions corresponding to predictions for how each of hundreds of players will perform. I am looking to identify the distinct distributions of players. In other words, I'm ...
- 455
3
votes
4
answers
222
views
Clustering methods ⊂ Unsupervised learning
Is it proper to say that clustering methods are mostly unsupervised learning techniques, with some exceptions such as model-based clustering?
- 637
1
vote
0
answers
763
views
Clustering based on distance measure violating triangle inequality
Suppose I have a set of categorical data $X=\{x_1,x_2,\cdots, x_n\}$, (in my case $n =~ 10,000-50,000$) as well as a precomputed "distance" measure $g(x_i,x_j)$ (in my case I just have an array of ...
2
votes
1
answer
1k
views
Clustering sequence on similarity using percentage identity matrix
I have a set of 400 nucleotide sequences and want to cluster them on basis of similarity. For clustering, I am expecting a similarity <=45% among members of a cluster. Also, there will be a few ...
- 121
1
vote
1
answer
266
views
Feature selection in clustering
I am looking for a method for feature selection in Gaussian Mixture Models. I have a dataset with 2000 records and 40 variables. I tried to use the "clustvarsel" package in R, which use the BIC as ...
- 11
2
votes
0
answers
203
views
Stochastic Block Model Priors
In the generic stochastic block model (binary edge data, no degree correction, etc.), if an uninformed prior is used for the Bernoulli coefficients i.e. Beta with $(a,b) = (1,1)$, will the model ...
- 21
1
vote
0
answers
110
views
Consensus methods for interpreting results of a cluster analysis
With cluster analysis, sometimes we want to assign meaning to the nature of the identified clusters. This is subjective and often done by a single person (or very few people) with perhaps some ...
- 3,703
5
votes
1
answer
3k
views
Best clustering algorithm for real estate data
I want to cluster real estate data to determine average price patterns in city and rural regions. My data set contains size, number of dorms, bathrooms and coordinates of the properties.
Which would ...
- 195
2
votes
1
answer
139
views
Unnatural clustering with known clusters shapes and optimization criteria
My question is similar to this question Clustering with shape prior, but with additional information.
The second answer suggests a mixture model approach to this problem, which is something like ...
- 75
0
votes
0
answers
520
views
How the quality of clusters made in SPSS can be evaluated?
How the quality of clusters made in SPSS with the method "TwoStep clustering" can be evaluated? Which test should be applied to be sure that the quality is good.
- 101
-1
votes
2
answers
137
views
What are Clustering techniques for this case? [duplicate]
What type of clustering methods are available for ordinal, nominal and ratio variables? Suppose I have one ordinal, one nominal and one ratio variable; is there a common clustering technique that can ...
- 1
0
votes
1
answer
441
views
R codes for variation of information criterion using "mclust"
I am developing model-based clustering.
First, I developed model-based clustering in R using "mclust." Next, I wanted to take 75% of the sample, re-run model-based clustering and compare the ...
- 51
3
votes
2
answers
1k
views
Create bins for lognormal data for cluster analysis
I have a series of dollar amounts that are highly right skewed, but are roughly log-normal. I want to put this grouped dollar amount as a predictor variable into a latent class cluster analysis. In ...
- 351
5
votes
2
answers
4k
views
LCA number of parameters & degrees of freedom
I have a series of physicians' claims submissions. I would like to perform cluster analysis as an exploratory tool to find patterns in how physicians bill based on things like Revenue Codes, Procedure ...
- 351