Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Cluster analysis is the task of partitioning data into subsets of objects according to their mutual "similarity," without using preexisting knowledge such as class labels. [Clustered-standard-errors and/or cluster-samples should be tagged as such; do NOT use the "clustering" tag for them.]

0
votes
0answers
7 views

Good place/program to do markov clustering?

I have a dataset of 18 nodes that I need to do markov clustering on for a school project. Unfortunately, the assignment really isn't well handled, particularly in telling us how to run the Markov ...
0
votes
1answer
8 views

Clustering on a dozen of dimension in a data-set

I have a data set, which I have created by aggregating at top hierarchy level. My data is based on user's statistics in using a website for about an year. Some of the dimension which I have captured ...
1
vote
0answers
7 views

How do these two clustering indices work?

I'm using the clusterCrit package in R that allows users to calculate several clustering indices and find the best number of clusters according to different criteria. There is a function in that ...
0
votes
0answers
9 views

Cluster analysis using mixed (continuous and categocrical) data with 40K rows in R [on hold]

I'm trying to do a cluster analysis using R and my data has both continuous and categorical variables. Is there a package in R that deals with both at the same time? doing hierarchical clustering ...
-1
votes
0answers
19 views

How to cluster categorical data [on hold]

I have a dataset (740 participants with 96 variables for each) and I'm wondering about the best way to perform clustering analysis on this? The goal is to see if subgroups (or clusters) will emerge ...
0
votes
0answers
7 views

Is there a way to calculate the Explained Variance with PAM or k-medoids?

I am studying geographic solar radiation data obtained from satellite images. I would like to and use cluster analysis and make some correlation analysis by clusters, instead of by pixel - as some ...
0
votes
0answers
10 views

how i found elements in every cluster in python [on hold]

In python i did cluster. I have a table with 26000 cloth's article and 52 weeks. The values in the table are the sold quantity of every article during the weeks. I'm doing clustering of time series.....
0
votes
0answers
4 views

How to interpret contrasting information from the Variation of Information, Dunn and Rand Index for comparing clusterings

There are related questions but the answers don't seem to explain how to practically judge these measurements for non stats users. I have a dataset which I clustered with K=4 using hierarchical ...
1
vote
1answer
31 views

In cluster analysis should I scale (standardize) my data if variables are in the same units?

I am performing cluster analysis (k-means and hierarchical) based on multiple variables. Each variable is in percentage 0-100% and the sum of all variables is at most 100%. I see that in many of the ...
1
vote
1answer
44 views

Comparing K-Means and Expectation Maximization on the dataset generated - When does K-Means perform better?

I was experimenting with K-Means and Gaussian Mixture Models (Expectation-Maximization) on the data set that I generated. Here is how the plot for two distributions looks like: Since this was ...
0
votes
0answers
12 views

Is clustering subsequences of time-series still meaningless with unsupervised learning?

In the paper "Clustering of Time Series Subsequences Is Meaningless" Keoh et al. claim that breaking a time-series into chunks (sometimes called lags) of fixed-size using the rolling window method ...
0
votes
0answers
11 views

How to find clusters of values among multiple matrices in R?

I have multiple time series matrices - belonging to different subjects - and would like find a function that finds clusters of similar values. It is my understanding that one can perform a Cluster ...
0
votes
1answer
21 views

Weakened version of k-means

I'd like to know if this "weakened" version of k-means exists. Pick a value $\delta > 0 $ small enough. Imagine you have computed all the distances between all the points in the dataset and the ...
0
votes
1answer
20 views

Comparing similarity Time Series

I have a collection of time series data. The data is structured (Country, Year, Value). ~50 countries and ~30 data points for each country Is there a way to cluster time series? Time intervals are ...
0
votes
0answers
8 views

Dynamic Time Warping w/ Different Sampling Rates

I am fairly familiar with the basics of calculating the Dynamic Time Warping distance between two time series but I am not sure if it can handle the following case: Two series sampled at different ...
0
votes
0answers
7 views

Does clusplot give a mirror-image to original dataset? [on hold]

I have obtain a clustering from well separated mixture component. When i'm doing clustering, i realize that the structure of clustering is like mirror image to real dataset as in figure. Does this ...
0
votes
0answers
8 views

How to do cluster analysis with ordinal and categorical data?

On SPSS I have a mixed data set, which suppose to help me to group people by their interest into two groups. One part of variables are ordinal (Likert scale 1-4) and other is categorical. I am lost ...
2
votes
1answer
79 views
+50

Splitting range of independent variable to maximize prediction within the subranges

I have a dataset with two independent variables $X,Z \in \mathbb{R}$ and a dependent variable $Y \in \mathbb{R}$. This dataset has the following characteristics: given some number $z$ and a "small" $...
0
votes
1answer
25 views

Accounting for “surgeon preference” when modeling a binary surgical outcome

I'm trying to model the risk of a binary event following surgery (event=admitted for observation, y/n), and my main predictor is a three-level 'treatment' administered during the procedure (Tx_A, Tx_B,...
0
votes
1answer
21 views

Is it important to make a feature scaling before using Gaussian Mixture Model?

Is it important to make a feature scaling before using Gaussian Mixture Model? and why is it important while we are using probability in getting our clusters's parameters (mean and covariance matrix). ...
0
votes
0answers
6 views

Proximity Matrix in Hiearchical Clustering

I have a proximity matrix from a hiearchical clustering calculation. I have used the Pearson Correlation as my distance metric. Is it valid to test the statistical significance of this value using a ...
2
votes
1answer
29 views

Cluster analysis of variables or observations?

I'm very new to cluster analysis. In papers such as Richette et al.1 (which tries to see which concomitant diseases cluster together), authors first cluster the variables and then the observations (i....
0
votes
0answers
10 views

Calculate variance lost after clustering

I'm studying clustering for system performance analysis and I'm interested in calculate the variance lost after clustering. Problem is this suppose I've 23 variables and 3000 observation. First I use ...
1
vote
2answers
23 views

How to optimize the result of K means

I am analyzing the data of abalone. My goal is to classify the data into three categories(premium, medium premium, and classic). Since it's an unlabeled dataset, so I utilized K means clustering to do ...
0
votes
0answers
16 views

what is the mathematical difference between the distances when clustering text

Suppose i have data for text clustering, there 300 000 rows text$GOODS_NAME let's do text clustering. ...
0
votes
1answer
13 views

Clustering data with outliers without ignoring them

I have 2 dimensional data about customer churn,i Clustered them with k-means but because of Outliers the clusters are not homogeneous.actually Outliers are about customers which are very important , ...
0
votes
0answers
11 views

Clustering data that includes a categorical variable with many different levels

I'm looking to cluster data on apartments. I have the following variables for each apartment: Latitude Longitude Price Number of bathrooms Number of bedrooms Amenities (washer, gym, etc.) The ...
1
vote
1answer
20 views

Clustering data that includes a categorical variable with many different levels

I'm looking to cluster data on apartments. I have the following variables for each apartment: Latitude Longitude Price Number of bathrooms Number of bedrooms Amenities (washer, gym, etc.) The ...
2
votes
2answers
36 views

Is there a clustering algorithm that maximizes average silhouette? If not, why not?

The average silhouette index of a clustering of data seems to be used to determine the hyper parameter $k$ (i.e. number of clusters) in clustering algorithms like $k$-means. Is there an algorithm that ...
4
votes
1answer
18 views

How to automatically cluster a U-Matrix?

After training a self-organising map, one can calculate the U-Matrix. There are some tools to manually visualize it and identify clusters, but I'm wondering if there is any algorithm to do this ...
0
votes
0answers
13 views

Clustering short messages

I have a dataset of short message conversations (from 1 to 20 words). I would like to cluster the messages that were sent to me to extract the different topics that were discussed by my interlocutors. ...
2
votes
0answers
12 views

What are the simple methods to do an unsupervised cluster to stock return time series?

I am a student in finance and I am working on my thesis project. I am interested in doing a clustering to stock time series. I first read the paper 'Time-series clustering – A decade review' from ...
0
votes
0answers
20 views

Remaining Skewness after log transformation

I am new in this community and I hope you could help me out. Right now I am working on a dataset which has multiple variables that are highly skewed. Below you can see one example of a variable ...
1
vote
0answers
7 views

How to cluster Categorical/Ordinal Survey Data

I have customer survey response data from Surveymonkey. I want to know what the best method would be for similarity analysis in order to create customer segments. Most of this data is categorical "...
0
votes
0answers
12 views

Job ad classification to occupation codes

I've scraped around 1.96 million job ads from online sources in the past year or so. I've done so in order to classify each ad against a specific qualification. This has worked well so far, however I ...
0
votes
1answer
21 views

Approach to clustering a large data frame (~7M * 60) with different data types

I posted a similar question yesterday. However, this question is distinct since I'm more seeking validation on my approach. I have a data frame with about 7M rows and 60 features. The features are a ...
0
votes
0answers
27 views

Matching new products with products those have actual sales data

New fashion products are arriving every season so I do not have historical sales data for them. Hence, I am using product attributes such as size,color, material, product group, price and some other ...
0
votes
0answers
12 views

Hybrid density based clustering using a distance matrix

I want to do clustering in my dataset in SAS for which I want to make following choices in my model: 1) Use a distance matrix which treats categorical variables and continuous variables differently ...
2
votes
0answers
22 views

Is Expectation-Maximization the right type of analysis (& if so, how)?

I have 118 microbes that I have tested at various concentrations of a drug that is supposed to kill them (0.1875 - 15). However, these microbes have mutations (A-H) which confer resistance to the ...
2
votes
0answers
26 views

methods to find causality between 1000 time series

I have an eco-system of 100 applications which each are monitored by let's say 100 metrics publishing every 5 minutes. So my dataset has 10,000 time series. I want to build/learn the dependency graph ...
2
votes
1answer
25 views

Appropriate clustering algorithm with mixed data types

I have a customer data set with several features. These features have mostly different meanings e.g. (Currency / Money) Customer monthly spend in $ (Count) Quantity of service x customer has active ...
2
votes
1answer
19 views

Which result for normalized mutual information is correct?

I wanted to find the normalized mutual information to validate a clustering algorithm, but I've encountered two different values depending on the library I use. In Python: ...
0
votes
0answers
12 views

Methods to minimize distance between features

What are some methods to minimize distances between features belonging to a cluster? I want to do this regardless of their class. Say I have a $m\times d$ feature matrix of $m$ samples, each with $d$ ...
2
votes
3answers
74 views

How to find strongly connected subgraphs in a graph? [duplicate]

I have a simple, undirected graph where I'd like to detect "natural" subgraphs where vertices are connected intensively internally but sparsely externally. The problem is that I have no exact hint ...
2
votes
2answers
59 views

Trajectory clustering - preprocessing and algorithms

Context Consider the following problem where we have two time dependent (yearly) measures: Fertility rate Life expectancy And a dimension: country. In other words we have over two hundred "...
1
vote
0answers
40 views

Interpretation scatter and cluster plots [closed]

I used the frequencies of different learning strategies that students mentioned in a 2x2 factorial within design (across 4 different situations) to draw up several plots in R. What I tried to find out ...
0
votes
0answers
16 views

clustering: what metrics can be used to measure both intra-class variance and inter-class variance, and what are their complexity?

I was considering using the silhouette score, however its complexity is $O(mn^2)$ which can quickly become prohibitive with the size of the dataset.
1
vote
0answers
10 views

Cluster/partition by time

I have a dataset of different events in time. I want to group/cluster/partition the data by datetime. A small example of the time of the data might be: [19-09-2018 12:00, 19-09-2018 12:01, 19-09-2018 ...
0
votes
0answers
27 views

Categorical data, clustering

I have records data from library: user-id, item-id, type of user, checkout date, gender, etc And information about item: author, date, publisher, publication year, title, item type, isbn, etc I want ...
0
votes
1answer
19 views

Clustering by same random projection

I have $N$, $1024$-dimensional vectors. I want to cluster them by some similarity. Given the high dimensionality, standard metrics won't work. I tried a few Approximate Nearest Neighbor ...