Cluster analysis is the task of partitioning data into subsets of objects according to their mutual "similarity," without using preexisting knowledge such as class labels. [Clustered-standard-errors and/or cluster-samples should be tagged as such; do NOT use the "clustering" tag for them.]

learn more… | top users | synonyms (1)

0
votes
1answer
22 views

DateTime Variable — Kmeans

Suppose I have a DateTime variable that I want to cluster on. I only really care about the day, hour, and minute. Is it wrong to create a column in my data set for each of these or should I keep the ...
1
vote
0answers
64 views

Combining AIC and BIC [closed]

For my dataset of ~19K data points to cluster, I want to use a criterion to choose the number of clusters. BIC (Bayesian Information Criterion) gives too few clusters (~180) while AIC (Akaike ...
0
votes
1answer
27 views

How to select the best number of clusters in cluster analysis in SPSS?

When I used SAS for cluster analysis, I used to use some plots of CCC, pseudo F and pseudo T^2 indices to help determine best the number of clusters. Not sure about this in SPSS, not familiar with ...
1
vote
1answer
35 views

normalisation in k means clustering on percentages and other numerical variables

I have several variables to include in k-means, some of them are percentages (between 0-1) and some of them are numerical variables (positive values). I know normalisation is required when the ...
0
votes
2answers
31 views

Similarity measure for clusterings in graphs evolving over time (temporal network)

From what I understand about clusters, they can be obtained from an existing graph at 1 instance of time. But consider the situation of a temporal network, such as a social network, where the graph ...
3
votes
1answer
101 views

Was it as valid to perform k-means on a distance matrix as on data matrix (text mining data)?

(This post is a repost of a question I posted yesterday (now deleted), but I've tried to scale back volume of words and simplify what I'm asking) I'm hoping to get some help interpreting a kmeans ...
0
votes
0answers
16 views

clustering based on string variables?

I am working on a project and currently experimenting cluster analysis. The dataset is mainly string variables, and I think my biggest three challenges in the data cleaning phase are the following: ...
0
votes
0answers
19 views

What is the best way to cluster the gower similarity matrix?

I have a dataset that contains the gower similarity of each observation from each other. So the dataset looks like this: ...
0
votes
1answer
25 views

Clustering sets of vectors

I have a set of $d$-dimensional vectors $\{v_1,v_2,\dots,v_n\}$, each of which has been assigned a label from a set $S=\{s_1,s_2,\dots,s_k\}$. I would like to find another set of labels $T=\{t_1,t_2,\...
0
votes
0answers
23 views

How to measure clustering algorithm performance? [duplicate]

For supervised learning, both regression and classification have ground truth. The model performance can be measured against ground truth. For example, $R^2$ in regression or accuracy (0-1) in ...
2
votes
0answers
35 views

Choosing evaluation measure for non-parametric clustering

I have to cluster some data using non-parametric clustering technique which is given in this paper. After all the cluster evaluation measure used in this paper is Normalized Mutual Information as they ...
0
votes
0answers
9 views

LSA Clusters Have the Same Words

I use LSA to create 5 document clusters and identify top 10 words nearest to cluster centroid. I found 4 words appear in all clusters(good, stay, staff, clean) . How to deal with this outcome? Should ...
2
votes
1answer
21 views

How do I choose the appropriate numbers of customers to be considered for cluster analysis?

I am currently doing a customer segmentation project in SAS. I have identified 2700 customers who are have made a purchase in each of the 4 years I am analysing. For the cluster analysis the more ...
0
votes
0answers
17 views

how to measure clustering task with unlabelled data set [duplicate]

I wanna know, how to measure the accuracy of a clustering method when we deal with data set without an a priori knowledge about class belonging ? (the data used for the clustering task, do not contain ...
0
votes
0answers
5 views

Characterize clusters composition

The problem I am performing a two-steps clustering task on a large dataset (a dozen variables but several hundred thousands of observations) by first using k-means and then using a Hierarchical ...
5
votes
5answers
147 views

What is the best way to detect repetition in xyz data for purposes of splitting data?

I'll use this picture to explain What I want to do is define some patterns as trained patterns. Then given data I want to be able to determine if the pattern exists in the dataset, and if it does ...
4
votes
4answers
138 views

Can PCA allow to identify redundant variables that can be removed before doing cluster analysis?

I hope this is suitable for this forum: I am new to PCA and what I ultimately want to do is perform cluster analysis on my dataset. I have 20 physical descriptor variables for organisms, each with ...
0
votes
0answers
6 views

Hard partitioning of the association matrix

I obtain a co-association matrix $n \times n$ that corresponds to the maximum likelihood estimate of the probability of pairs of variables being in the same cluster. Further suppose that there are $k$ ...
2
votes
1answer
39 views

What is the definition of a kernel on vertices or edges?

I am currently trying to perform clustering on a collection C of undirected and unlabeled graphs. I decided to use to a kernel on graphs to obtain the kernel matrix of C. Then I can derive the ...
5
votes
5answers
240 views

Clustering of variables: but they are mixed type, some are numeric, some are categorical

I have a dataset with 15 variables. Some variables are numeric, continuous. Other variables are boolean, dichotomous (true/false). There's also one variable categorical, nominal. ...
1
vote
1answer
65 views

Instruct me about K-Means Clustering

I have been instructed by my supervisor to run K-means in Matlab on my data which is comprised of sensory data observations that pertain to 7 outcomes, which I have labeled using numbers from 0 to 7. ...
0
votes
0answers
72 views

factor model and large covariance matrices

Imagine the number of variables $\textbf{p}$ is 5 times larger than the number of observations $\textbf{n}$ and the sample covariance matrix is almost block diagonal (with low off block diagonal ...
0
votes
0answers
11 views

Grouping target variable into bins of minimal variance for uniformly-observed, seasonal timeseries data

I am looking at a key performance indicator that is measured uniformly over time for which I strongly suspect seasonality. I would like to create groups to identify periods of time where observations ...
12
votes
4answers
2k views

Does “curse of dimensionality” really exist in real data?

I understand what is "curse of dimensionality", and I have done some high dimensional optimization problems and know the challenge of the exponential possibilities. However, I doubt if the "curse of ...
1
vote
1answer
15 views

Cluster evaluation in system that implement auto determine cluster number

First of all, how to know wheter document clustering result was "good" or "bad"? Not in ordinary k-means, but in algorithm that enable automatic cluster number, like g-Means. Came across Q&A ...
6
votes
2answers
55 views

k-means++ algorithm and outliers

It is well known that k-means algorithm suffers in the presence of outliers. k-means++ is one effective method for cluster center initalization. I was going through the PPT by the founders of the ...
0
votes
0answers
15 views

Relation discovery between two time series data

I'm looking at analyzing the relation between temperature & sales/searhes of particular product at a daily grain The relationship is little complex, for example Sales go up for low temperature ...
0
votes
0answers
14 views

Simple English translations regarding thematic textual analysis

I have run a thematic textual analysis of economic select committee meetings in the UK using t-lab. I ran a thematic analysis of the E.C.U.s, and categorised the E.C.U.s into (for example) 5 thematic ...
0
votes
0answers
11 views

Defuzzification in fuzzy clustering

I am using fuzzy c-means algorithm to cluster my data. To give labels to data in the end, I choose the class which has the highest probability for each data point and assign that point to that class. ...
1
vote
1answer
19 views

Statistical Test for Embedding?

I have a bunch of labeled objects. Let's say there are K classes altogether. Now suppose every object is mapped to a data point in R^n, or in other words, is embedded in R^n. Ideally a good embedding ...
1
vote
0answers
10 views

Choosing a cluster with low variance and many data points

I have data points that have been grouped using k-means clustering. Some of these clusters may only have one data point, which would give them a variance of zero. But I am more interested in the ...
1
vote
1answer
28 views

How to differentiate two distinct linear populations with clustering in R

I am new to clustering. My apology if this has been asked before. I'd like to differentiate two distinct linear populations within sample matrix, and tag them differently. Apparently k-means couldn'...
0
votes
0answers
24 views

Using spectral or hierarchical clustering for small world graph

Suppose we have a weighted edge graph with small-world property and we want to cluster the nodes of the graph based on the edge weights as similarity of nodes (the weight of an edge shows the ...
0
votes
0answers
8 views

How can I cluster data points according to the local minima they belong to?

I'm using the genetic algorithm for hyperparameter optimisation. My loss function is the cross-validated loss, that means I can evaluate my loss function but I don't know how it looks like (the shape)....
9
votes
4answers
296 views

With categorical data, can there be clusters without the variables being related?

When trying to explain cluster analyses, it is common for people to misunderstand the process as being related to whether the variables are correlated. One way to get people past that confusion is a ...
1
vote
0answers
22 views

Applying DBSCAN to a huge GIS dataset with a Haversine distance metric.

I have a training set (2GB) that contains GIS trajectory data for multiple taxi rides. I want to cluster the final destinations based on their spatial density and have therefore been trying to use the ...
0
votes
0answers
18 views

Clustering on two feature spaces

I want to do a clustering task with my data to find some interesting patterns. I have two groups/vectors of features V1 and V2 which are fundamentally different and are supposed to measure different ...
1
vote
0answers
22 views

Z-score transformation for joint cluster analyses

I am dealing with a situation where I need to use a joint matrix of approximately gaussian distributed data (limits - Inf to + Inf) and beta-distributed data (both produced using different ...
1
vote
2answers
41 views

Analysising the difference between k-means and spectral clustering algorithm

My target is to cluster the spatial area based on the location(X,Y) and pollutant concentration(Z). So there would be three different attributes along the spatial area(n_sample = grid point) I have ...
0
votes
0answers
30 views

estimate NND in the cluster with missing data

Would very appreciate any comments on the following problem: Imagine one has N sets of elements (points on the plane), coordinates (x,y) of 30% of the points in each set are known. So if we have 30 ...
1
vote
1answer
33 views

How Gower's dissimilarity handle missing values in numeric columns?

I would like to ask a question about Gower dissimilarity, I was wondering how Gower measure handle missing values in numeric columns, especially that Gower standardized each column based on the range ...
0
votes
1answer
26 views

Ideal Inertia for k-mean clustering convergence

Is there an ideal "inertia" for K-mean convergence. For example I'm trying to cluster to 64 clusters using sci-kit. the output is ...
5
votes
1answer
78 views

Clustering very small datasets

I am looking for methods to cluster very small datasets. Almost all methods I have seen talk about how well they work on very large datasets. By small I am talking 5 elements, 20elements, maybe 50 ...
1
vote
0answers
15 views

Stability of clusters/mixtures from GMMs

Some background I have a data set with around 2000 samples and 16 features. Me and my colleague are trying out different methods for clustering and currently we are converging to the usage of a ...
0
votes
0answers
40 views
-1
votes
1answer
27 views

Cluster Analysis for Website Data [duplicate]

I want to perform cluster analysis on the data of a website. The data is mainly visitor history(97000 rows) and has following variables: a)User Device Category b) Traffic Marketing Channel c) Traffic ...
0
votes
1answer
47 views

How to cluster an 1-D array by K-means or any other algorithm using scikit-learn? [closed]

I have an one dimensional toy array X. I want to cluster the data into some numbers of clusters.But when I try to fit my data in scikit-learn K-Means function it shows ValueError: n_samples=1 ...
1
vote
0answers
22 views

Clustering algorithm for multisorted data

I have two sets (“sorts”) $A$ and $B$, and a multiset $R$ whose underlying set is a subset of $A \times B$. I need a clustering algorithm, where each generated cluster consists of two subsets $S \...
0
votes
2answers
46 views

How should I determine what seed to use while using “flexclust” package?

I am trying to find a clustering solution with the help of flexclust package in R. The following code has been adapted from the vignette for the ...
-1
votes
2answers
29 views

How to cluster the data? [duplicate]

I have a data that looks like below and I want to cluster them. What would be the best algorithm to apply for clustering such data. Thanks