All Questions
Tagged with cluster or clustering
4,041 questions
2
votes
1
answer
52
views
Clustering in 5-point Likert type dataset
I want to cluster the data collected with a 5-point Likert scale. But I couldn't understand which method is more accurate to use. I searched the literature but couldn't find a clear answer. Can you ...
- 53
2
votes
0
answers
16
views
How to cluster based on x and y coordinates
I am trying to identify rows in groups of points using clustering algorithms. The bigger picture problem I'm trying to solve is to identify shelves given x and y coordinates of products. I can cluster ...
- 121
0
votes
0
answers
9
views
Should I average data for agglomerative hierarchical clustering (AHC)?
I was conducting an experiment where I measured the response of wheat cultivars to pathogen inoculation. The experiment was repeated three times, with two reps each time. Two disease parameters were ...
0
votes
0
answers
11
views
SVD before clustering method (no dimensionality reduction)
Does it make sense performance-wise to apply SVD to a dataset before applying a clustering method? I mean: is there a statistical reason to do such a thing? Does it depend on the method, on the number ...
- 4,362
0
votes
0
answers
31
views
Missing values in data set before DBSCAN
My goal is to identify bots and fraudulent users for an application. Ideally, this would be a regression problem where users are rated on a continuous scale. I have 4 tables that cover different ...
- 1
0
votes
0
answers
11
views
Identify predictors for clustering output?
I have a dataset with variables collected years ago, and many variables collected this year as outcome variables. I want to combine all the variables collected this year to get one outcome, e.g. ...
- 43
0
votes
1
answer
27
views
Index of spatial variability
I have a geographical area, divided in municipalities. Each municipality has the count of a disease occurrences. The procedure is replicated four times, for four diseases (we can call them A, B, C, D)....
- 161
0
votes
0
answers
12
views
mice multilevel imputation: does specifying cluster variable ("-2" in predictor Matrix) without multilevel methods lead to cluster robust imputation?
In short: Are mice's imputations cluster robust when I only specify the cluster variable with "-2" in the predictor matrix but do not use multilevel models during imputation?
For clustered ...
- 1
2
votes
2
answers
544
views
Where is the inflection point here in this elbow chart?
Where do you think is the inflection point on this chart?
3
votes
2
answers
203
views
Clustering two-dimensional data in R [closed]
I have 35 linear models in a data frame (b is intercept, a is coefficient):
...
- 33
1
vote
0
answers
19
views
Question about running k means cluster analysis
In a previous analysis I had 3 groups of subjects - group x with 35 subjects, control group y with 25 subjects, and control group z with 25 subjects. For each group I have levels of 6 different ...
4
votes
1
answer
51
views
Am I dealing with within-cluster dependence or independence? (Cox proportional hazards model/frailty model)
this is my first time asking a stats questions anywhere online. I'm a young female PhD student and quite anxious about this, so if possible, please be kind. I'll do my best to ask my questions clearly....
- 41
1
vote
2
answers
66
views
Cosine similarity usefulness for continuous variables
I have been asked to identify a 'cohort' of products similar to productA, and someone suggested I identify a set of relevant features and compute the cosine similarity between each possible similar ...
- 391
1
vote
0
answers
15
views
Finding the most important daily pattern on a time series
I have multiple hourly time series measurements from different measurement points, for multiple weeks. My goal is to eventually cluster the measurement points into clusters, but to reduce ...
- 11
1
vote
0
answers
40
views
Question on using the elbow method for calculating ideal number of clusters for k means cluster analysis
Newb to cluster analysis here. I have a group of 35 subjects. For all of the subjects I have data for different measures of IQ (verbal, math, etc) and different biomarkers. There are 6 IQ measures in ...
0
votes
0
answers
7
views
Creating a Dependent Ordinal variable from Independent Ordinal Variables (all with 6 levels) using Kmodes Clustering technique
I want to create a dependent ordinal variable from independent ordinal variables with 6 levels {'Very satisfied': 5, 'Satisfied': 4,'Neither satisfied nor dissatisfied': 3,'Dissatisfied': 2,'Very ...
0
votes
0
answers
21
views
Clustering on clusters
I'm working on a problem where I need to categorize pore types in different sponges. To do this, I use the HDBSCAN clustering algorithm to create sponge-specific (or "local") clusters. I ...
- 43
0
votes
0
answers
16
views
Algorithm to cluster data points with categorical data and existing labels
Suppose that I have a dataframe of e-commerce product views data, where each row represents a product view and whether it led to conversion (purchase / not purchased)
Sample columns of the data: ...
0
votes
0
answers
25
views
Why would the "dirichletprocess" package in R return the number of clusters of the last MCMC iteration?
I've been working with the "dirichletprocess" package in R, specifically trying to recreate the example shown in the vignette where they cluster the eruptions in the Old Faithful dataset ...
0
votes
0
answers
13
views
Are x-means' BIC and likelihood scores comparable between clusters of different dimensionality?
I'm currently working on implementing an x-means variant and ran into an issue when computing the Bayesian Information Criterion's log-likelihood (via scipy's multivariate normal logpdf) which fails ...
1
vote
1
answer
68
views
Stochastic blockmodel with continuous weights in [0,1]
I want to use a stochastic blockmodel (SBM) to cluster the nodes in a network where the edge weights are continuous numbers between 0 and 1. It seems that R-packages such as ...
- 28.3k
0
votes
0
answers
19
views
Clustering Mixed Data Types: Algorithm Selection, Distance Measurement, and Feature Weighting
I have a database of 74,000 records with 29 features. Fourteen of these features are categorical and are either 0 or 1, while the other 15 features are continuous and have been normalized and scaled ...
0
votes
0
answers
15
views
Statistical techniques to compare leaves position across ordered trees
I want to tackle this problem.
Suppose I have a set of entries that can produce multiple ordered trees based on some statistical methodology. The entries are always the same, but the tree structure ...
- 445
0
votes
0
answers
12
views
Scale z-normalized data back to original data range (using clustering of time series)
I am a little bit confused about the information from tslearn package for Python.
It says in the documentation (e.g. https://tslearn.readthedocs.io/en/stable/auto_examples/clustering/plot_kmeans.html) ...
1
vote
1
answer
40
views
What's the minimum number of points worth clustering? [closed]
I'm using HDBSCAN to cluster vector embeddings of sentences. The embeddings are being drawn from an online SQL table that's constantly being updated. At peak times, this means 1,000 embeddings an hour,...
- 667
0
votes
0
answers
31
views
Identifying clusters to correct for scatter
I am developing Python software for reducing residual gas analysis mass spectrometry data, specifically focusing on outlier detection via helium-3 spike intensities. We use helium-3 as a reference ...
- 113
1
vote
0
answers
18
views
Clustering and samples weighting (using GEE)
I am currently analyzing the social factors associated with the prevalence of infectious diseases in European countries using GEE models. My data is based on patients covered by a specific health ...
- 11
3
votes
1
answer
51
views
Can I use ANOVA after clustering?
I am helping someone analyse data on plant species. They divided a town into equal-sized squares and collected data on the weed species growing in each square. I used cluster analysis (Ward.D2) to ...
- 31
0
votes
1
answer
24
views
Clustering method for frequency embeddings
I have, for example, the following lists of words that I want to cluster. The lists could have different lengths, and the vocabulary is $W = \{a,b,c\}$. The criteria of clustering 2 lists into a same ...
- 21
0
votes
0
answers
20
views
Multiple ordinal independent variables, correlation control and clustering
I conducted a survey with 25 5 point questions that resulted in a Likert scale Score variable, while also collecting several ordinal demographic variables: years employment, tasks per year, salary, ...
1
vote
1
answer
31
views
Loss functions for unsupervised clustering of gaussian data
I got data that was generated from $n$ multivariate gaussians with different means and covariances, which means that they are separateble, and I'm tasked with classifying them using neural network in ...
- 157
2
votes
0
answers
16
views
Unsupervised clustering of short texts with covariates
I posted this on the Data Science Stack Exchange and didn’t get any responses (that sight seems pretty dead). So I’m trying here!
I'm working on a project where I have to categorise short texts. I don'...
- 45
0
votes
0
answers
21
views
Where does Holder inequality come in during the proof of Gap statistic?
I am struggling to understand the proof from the Gap-statistic paper (https://hastie.su.domains/Papers/gap.pdf)
However, I am stuck here as shown below. I cannot understand where Holder's inequality ...
- 303
0
votes
0
answers
18
views
Kproto, Kmeans and Gower with PAM (General Clustering Analysis)
Hi I have around 654 rows of data with mixed variables (both numeric and categorical). I have done all the scaling, transformation for numerical variables and replaced missing in both numerical and ...
0
votes
0
answers
14
views
calculation of the C-index clustering for manual [duplicate]
Can anyone give me an example of working on the C-index clustering validity test, but calculating manually??
- 1
1
vote
0
answers
22
views
Spatial Temporal Clustering evenly spaced over time
I have a large dataset of spatio-temporal data. It has longitude and latitude coordinates, and a date for each observation. For example:
Long
Lat
Date
50
20.43
9-19-2010
51
19.5
10-4-2010
51
19.3
...
- 121
0
votes
0
answers
44
views
Choosing number of classes in LCA
I'm an undergrad student, a little confused about goodness of fit tests. I'm trying to choose the appropriate number of classes for a latent class analysis using ...
1
vote
1
answer
34
views
Performing a PCA on data of different hierarchical levels
I (novice) plan to use a PCA on several different, related, i.e. non-orthogonal questionnaire measures. These measures have composite scores (item sums etc.) and some of them have sub-facets. Also, ...
- 11
0
votes
0
answers
17
views
Declustering impact, stationarity and discretization
I have a seasonal time series, and I am considering declustering (before any other preprocessing steps) it using runs declustering. If I observe an extremal index of 1, can I claim that my data is i.i....
- 1
2
votes
0
answers
24
views
Quantifying a Sequence of Binary Outcomes
I'm compiling a dataset on animal color patterns. Blotches flank the body of the animal (Agkistrodon contortrix) and meet along its midline (i.e., spine). At midline, the blotches can join ...
2
votes
2
answers
50
views
Does clustering actually reduce the number of rows in a dataset?
I am reading the book "grokking Machine Learning" by Luis G. Serrano and came across the following sentence:
"It seems that clustering and dimensionality reduction are nothing like each ...
- 129
0
votes
0
answers
11
views
What are the right metrics to validate the performance of a custom clustering model with three possible outcomes?
I have developed a custom clustering model on top of MiniBatchKmeans, that has three possible outcomes for each data point:
Assign the point to the correct cluster.
Assign the point to the wrong ...
0
votes
0
answers
21
views
How can I assign households to coordinates in a social space consistent with pairwise distance measures?
How can I assign households to coordinates in a social space consistent with pairwise distance measures?
I have a question which is somewhat ill-defined, about creating an interesting and useful ...
- 3,247
0
votes
0
answers
10
views
Fuzzy cluster analysis with binary and continue data
I am using R to conduct a fuzzy cluster analysis. I was told that the common fuzzy c means (which is similar to the k mean in the crisp cluster) is not suitable for mixed types of data.
I was ...
- 1
0
votes
0
answers
21
views
How to compare multiple point patterns of the same realm resulting from different clustering methods?
I have a dataset of 500 sampling points to which I apply multiple different clustering methods for categorization. How can I compare the resulting spatial point patterns of cluster group labels? I ...
- 1
0
votes
0
answers
22
views
Looking for a suitable way to find groups of events
I have an excel file in which I have three columns. The first one is the name of an event, the second one is the moment the event starts and the third one is the time at which an event ends. Let's say ...
- 205
0
votes
0
answers
28
views
How to cluster time-of-day event data?
Suppose I have data about patient sneezes, e.g.,:
Name Time Loudness
Alex 07:59 10
Bob 08:03 12
Charlie 17:06 9
Alex 08:09 13
...
You can see ...
- 2,256
5
votes
2
answers
297
views
Is domain knowledge external validation in clustering?
I have cluster results with good values on etc Silhuette Width. The cluster sizes are: 4998, 1, 1 which isn't good knowing my customers doesn't have that particular partition (it's more balanced). I ...
5
votes
2
answers
85
views
Clustering by discrete, unrelated properties?
I have a large number of objects that have unrelated properties such as
color=yellow
material=stone
...
- 151
1
vote
1
answer
27
views
Quantifying (observed) spatial clustering?
I am looking for some advice regarding spatial statistics.
I have a large dataset with multiple samples across 5 different conditions. Each sample is composed of different point types in 2D space. For ...
- 13