Questions tagged [clustering]

Cluster analysis is the task of partitioning data into subsets of objects according to their mutual "similarity," without using preexisting knowledge such as class labels. [Clustered-standard-errors and/or cluster-samples should be tagged as such; do NOT use the "clustering" tag for them.]

Filter by
Sorted by
Tagged with
0 votes
0 answers
7 views

What methods can I used to assign cases to groups when some variables are dependant on others?

I have a sample size of 42 cases, with about 5 variables for each case. Most of these variables are measurements, and I want to assign the cases into 2 groups (condition present, and condition absent) ...
user avatar
  • 1
0 votes
0 answers
8 views

Hierarchical clustering output 99% belongs to a cluster group

I've just done a clustering analysis using hierarchical clustering analysis in Python but the result is not what I expect. Most of them (483/485) belongs to group 1 and the rest to group 0. Is there ...
user avatar
2 votes
1 answer
13 views

Image Clustering (Unsupervised learning) on unknow class(guess less than 300)

I have 30000 unlabeled images (each image has only one character), and the content of the images is very simple, basically black lines(a language but not English) and white background. I hope to use ...
user avatar
0 votes
0 answers
12 views

Help! Cluster analysis of curves - grouping already grouped data

I have derived a number curves which illustrate the relationship between two (non-time) variables at different locations. I want to be able to group these curves / functions together, so that ...
user avatar
0 votes
0 answers
12 views

How to avoid having very different examples inside a cluster with Kmeans?

Let's say I've created some clusters with Kmeans using 5 features, the Silhouette Score for these cluster are very high, higher than 0.8, and The within-cluster sum of squares is around 130 in this ...
user avatar
0 votes
0 answers
7 views

Runtime limitations of spectral clustering? [closed]

I'm trying out spectral clustering for the first time, just messing around with it based on scikit-learn documentation. My data is ~5,000 rows x 3 columns. I'm running the default configurations in a ...
user avatar
0 votes
0 answers
20 views

Which clustering methodologies are likely to be best for this data?

I'm using the classic "use-case" example of clustering pixels in a photograph. I've tried K-means, agglomerative clustering, and DBSCAN. When I plot the RGB coordinates in 3-D space, all 3 ...
user avatar
3 votes
1 answer
42 views

Distance between two clusters after their joining in centroid linkage

For a distance between two clusters A and B of objects given by $d_{AB}=\left \|{m_{A}-m_{B}} \right \|^{2}$ , where $m_{A}$ is the mean of the objects in cluster $A$, show that the formula ...
user avatar
  • 33
0 votes
0 answers
26 views

How to test the statistical significance of several clustering algorithms? [closed]

I have computed ARI, NMI and Silhouette scores of several clustering algorithms on single cell RNA sequence data. These metrics are computed three times for each algorithm and for each dataset. Now, I ...
user avatar
1 vote
1 answer
10 views

High Performance Classification or Similarity Algorithim for Mixed Data Types?

I have a database holding 10-ish features that describe different breeds of dogs. They are mostly categorical features, but some provide ranges for values. Here's a demo representation of the database,...
user avatar
0 votes
0 answers
29 views

Cluster Validation and Sample Size [closed]

I've recently been using the aweSOM package in R https://cran.r-project.org/web/packages/aweSOM/vignettes/aweSOM.html. The objective is to generate a SOM then impose partitive clustering on top, in ...
user avatar
  • 174
0 votes
0 answers
10 views

How to interpret a PCA score plot?

I get a following score plot for the breast cancer dataset. The score plot has been clustered into two categories. I want to know what inferences could I draw from it?
user avatar
0 votes
0 answers
7 views

Cluster Validation on SOM Codebook

I've recently been using the aweSOM R package for cluster visualisation, https://cran.r-project.org/web/packages/aweSOM/vignettes/aweSOM.html. In particular, the aweSOM package entails using ...
user avatar
  • 174
2 votes
1 answer
59 views

Clustering while knowing the ground truth: Why would someone choose this approach?

If the ground truth of the class/cluster/segment that our observations belong to, is known in advance, why would someone choose to perform clustering instead of classification? In fact, doesn't the ...
user avatar
0 votes
0 answers
8 views

Treating time as a continuous variable when analyzing a stepped wedge design

I am in the process of analyzing a stepped wedge clinical trial, examining the effect of an intervention aiming to improve rates of outcomes data collection (e.g. depression scales, quality of life ...
user avatar
  • 1,451
0 votes
1 answer
34 views

How can I find the start of a range in an automated way?

I am looking at real estate sales data for different regions. I bin the data by sold price range in 1000 increments (see below). I am looking to find the start of the price range or cluster in which ...
user avatar
  • 1
2 votes
1 answer
27 views

What variable type to choose for a Poisson distributed variable if software package only allows for nominal, ordinal or continuous

In the area of cluster analysis I want to calculate the dissimilarity for my data (actual use case is to feed in the dissimilarities into a plotting function to calculate so called silhouette plots). ...
user avatar
  • 511
0 votes
0 answers
23 views

Clustering high-dimensional, categorical data

I'm trying to cluster ingredients in recipes to see which recipes cluster together. This is a kaggle dataset here: https://www.kaggle.com/datasets/shuyangli94/food-com-recipes-and-user-interactions ...
user avatar
  • 103
2 votes
0 answers
25 views

High dimensional behavior of Dirichlet Process-based clustering?

I have a problem stemming from Dirichlet Process Gaussian Mixture Models (DP-GMMs) in high dimension. I'll write this question so that no knowledge of DP-GMMs is needed. Let $D$ be the dimensionality ...
user avatar
1 vote
0 answers
13 views

Cluster a signal to minimise variance of each cluster with constraints on cluster size

Assume there is an incoming signal which may have some noise to it. This is essentially an ordered 1d data. I am looking for an algorithm which can group the data points into groups with minimum ...
user avatar
0 votes
0 answers
9 views

Spatial clustering with maximum group weight

I am looking for a clustering method that would allow spatial clustering of a set of points (with weights associated to each point) with maximum cohesivity, where each group of points must have at ...
user avatar
0 votes
0 answers
20 views

cluster by multiple linear regressions

If I have an X and Y feature, can I cluster by what linear regression two populations fall on? Consider: In the pink is one regression. In the yellow is another. I know that these two lobes are ...
user avatar
0 votes
1 answer
28 views

How to split the data into multiple (normal) distributions or clusters?

I am trying to train a machine learning model to predict yield on fields, based on multiple parameters, such as elevation, humidity, and nitrogen content. Observing the historical harvest data, I ...
user avatar
  • 1,263
0 votes
0 answers
22 views

Using traj package for clustering a set of rows

I have a dataset that contains the observations of 30 people and each of them had done 20 experiments. But for simplicity let's assume I have a dataset like this: ...
user avatar
  • 101
1 vote
1 answer
20 views

Online clustering approach

Is there any "online" clustering approach? I mean that the procedure should be like this: Can be fitted with the initial portion of data. Can be updated with the upcoming batch of data. The ...
user avatar
0 votes
0 answers
13 views

Multivariate Time Series Clustering with Affinity Propagation

I'm trying to implement the clustering procedure described in the paper that follows at the link https://www.hindawi.com/journals/wcmc/2021/9915315/, but I get to the algorithm 2 described and I get ...
user avatar
  • 1
0 votes
0 answers
20 views

GMM clustering with binary and multicollinear data

I am using GMM clustering on bank data. The data have both categorical and numerical attributes. The categorical data were converted to numerical using binary encoding. I have a couple of questions: ...
user avatar
1 vote
0 answers
48 views

List of algorithms used to cluster weighted undirected graphs

What clustering methods are suitable for weighted graphs, where the weights cannot be interpreted as a metric ? (e.g. they do not respect the triangle inequality). At the moment I found Markov ...
user avatar
  • 653
0 votes
0 answers
29 views

Estimating the likelihood of a Dirichlet process

I am not sure if what I'm trying to achieve makes sense or is even possible, but I'd like to do MLE on a Dirichlet process mixture model. My reasoning is the following: If we can write out the ...
user avatar
  • 273
1 vote
1 answer
27 views

Intuitive explanation of Ward's method

I got this explanation of the Ward's method of hierarchical clustering from Malhotra et. al (2017), and I don't really get what it means: Ward’s procedure is a variance method which attempts to ...
user avatar
0 votes
0 answers
30 views

How to use RFM along with Predictive model?

I am looking to segment my customers based on their transactional data with us. Based on google search, I came to know about RFM matrix, which records Recency, Frequency and Monetary value-based ...
user avatar
  • 1,758
1 vote
0 answers
11 views

Why max(b,a) in Average Silhouette?

Average Silhouette is one of the popular methods to decide number of clusters in a clustering algorithm. Why should we use max(b,a) in the denominator of the formula? So why not just avg(a,b). I guess ...
user avatar
  • 11
1 vote
0 answers
8 views

For the given data find the clusters. Assume the relevant parameters needed [closed]

Below is the given data, how can I make clusters using symmetric matrix?
user avatar
2 votes
1 answer
36 views

Confusion on why the value of SSE is lower when a cluster looks distorted on the plot

I have a dataset of shape (29088, 11). When I apply the Kmeans where K=2 I get the following plot: Cluster C0 has 8554 points (in blue) and cluster C1 has 20534 ...
user avatar
  • 151
0 votes
0 answers
8 views

Cluster confidence scoring

I have a scenario where I am provided a list of clusters and pairwise distance only between items in same cluster. I need to rank these clusters based on some kind of relative score from this info. e....
user avatar
1 vote
1 answer
15 views

How to fix intersection of cluster distributions in R

I need help with a clustering task I'm doing. The essence of the problem, there is data on vegetation indices. Simple example for R ...
user avatar
  • 199
0 votes
1 answer
32 views

In which category falls a mix of unsupervised and supvervised learning?

Here is the context of my problem: I want to classify between to classes. However, I have at disposal only non labeled data to do the training (the test set possess all labels for evaluation purposes)....
user avatar
  • 9
0 votes
1 answer
19 views

Why does single linkage create loose clusters when it uses smallest distance between two points?

The definition of single linkage says: In single linkage method, the distance between two clusters is defined as the minimum distance between two data points in each cluster. However, different ...
user avatar
0 votes
0 answers
14 views

Cluster analysis of time series data with a few points in time

I have asked the question here before but have not been able to resolve it. I have data from 150 participants who were asked about their emotional state at 3 points in time. There are 28 different ...
user avatar
2 votes
1 answer
33 views

Graph/Network Clustering Models that Use Covariate Information

I have been reading about Clustering Models on Graph/Network data. For example, there seems to be a popular Clustering Model for Graph/Network data called Louvain Clustering (https://en.wikipedia.org/...
user avatar
  • 5,698
0 votes
0 answers
29 views

Explainable clustering for broker churn

I have a dataset like as below You can see that my dataset is longitudinal. There will be multiple records for the same broker with multiple or same customer, selling same or different products. Now, ...
user avatar
  • 1,758
0 votes
0 answers
28 views

K-Means clustering should cluster data evenly distributed or unevenly distributed? [duplicate]

I am clustering customers using their stay time on our web sites. When I only use one variable, time, for K-Means clustering with 10 clusters, customers look unevenly distributed to each clusters. ...
user avatar
  • 2,585
1 vote
1 answer
51 views

Measuring the performance of a clustering algorithm with "true" clusters available

Suppose I have observational units $x_1, \dots, x_n$. Each of these units is in a known cluster $C_1, \dots, C_m$, $m < n$. A ML algorithm generates based on a metric new clusters $C^{*}_1, \dots, ...
user avatar
  • 3,883
0 votes
0 answers
38 views

DBSCAN clustering - epsilon

How do we decide on the optimum epsilon and min_samples to be specified given our data? Take this for example - Demo of DBSCAN clustering algorithm via https://scikit-learn.org/stable/auto_examples/...
user avatar
  • 23
0 votes
0 answers
22 views

clustering sets of numbers

I have some experimental measurements which come in sets $S_i$. Each $S_i$ contains some floating point numbers $s_{ij}$. I think the $S_i$ form clusters with similar contents. How do I assign the $...
user avatar
0 votes
0 answers
26 views

How to choose a fair gamma value when performing k-prototypes clustering?

In the k-prototypes clustering algorithm, the distance function consists of two dissimilarity components - one for the numerical elements of the observations, and one for their categorical elements. ...
user avatar
1 vote
0 answers
15 views

Regression With Multiple Groups in a Dataset

I am trying to predict grocery store sales from the number of cars in the parking lot. I have a dataset of around 400 stores, over two years, with a count of the number of cars in the lot at the same ...
user avatar
  • 11
0 votes
0 answers
16 views

Want to understand dendogram's basic expample from scipy website

I like to understand, how the given array leads to corresponding points in x and y coordinates? ...
user avatar
0 votes
1 answer
19 views

Applying clustering on any image

I want to clustering algorithm to the below image in jupyter platform. I'm trying to learn on my own. I do know how to implement the code but I don't know how to take the below image as an input ...
user avatar
0 votes
0 answers
24 views

Shapley values for the three clusters by cluster number KMeans algorithm

I am trying to replicate this https://cast42.github.io/blog/datascience/python/clustering/altair/shap/2020/04/23/explain-clusters-to-business.html#Kmeans-clustering But using R and not Python as in ...
user avatar
  • 1

1
2 3 4 5
76