Tagged Questions
3
votes
0answers
17 views
Which variables are driving correlations within groups
I'm running an analysis on a few data sets that each typically have 100-200 cases measured across 120-160 variables - something similar to looking at gene expressions. Each variable is a non-centered ...
3
votes
0answers
54 views
Cluster on high dimensional categorical data (Images with keywords)
We're looking for clues to perform a Cluster Analysis in a DB with +400K images which have keywords associated to them.
Each image could have from 1 to 30 keywords.
Total keywords count is +35K.
...
1
vote
2answers
119 views
Evaluation of k-means output for >3D
I'm implementing the k-means algorithm (in R Map-Reduce) and I wanted to verify if the output I'm getting is close enough to the true centroids of the cluster. This is how I'm verifying with a 2D ...
1
vote
2answers
123 views
Clustering large scale data in fine-grained clusters
I've got large amount of data (e.g. 100K) and I want to cluster them in very fine-grained clusters (e.g. 10K). I look for an appropriate algorithm that uses the similarity function instead of whole ...
1
vote
2answers
264 views
Hybrid (K-means + Hierarchical ) clustering
I have a huge dataset (50,000 2000-dimensional sparse feature vectors). I want to cluster them in to k (unknown)clusters. As hierarchical clustering is very expensive in terms of time complexity ...
4
votes
1answer
273 views
Suggestions for multi-dimensional clustering
I am working in a genomics project and I ended up having a huge table with around 800 measurements (cases/rows), around 200 channels (columns/continuous variables) and 5 categories (one categorical ...
3
votes
2answers
291 views
Clustering of 10's of millions of high dimensional data
I have a set of 50 million text snippets and I would like to create some clusters out of them. The dimensionality might be somewhere between 60k-100k. The average text snippet length would be 16 ...
2
votes
1answer
110 views
What is heavy hitter analysis?
I have some data on the number of times each of my machines turned off (due to an error) in a particular time period. There are about 6 different classes of machines being used to construct a total ...
4
votes
3answers
277 views
Looking for sparse and high-dimensional clustering implementation
I'm looking for a clustering implementation with the following features:
Support for high-dimensional data. Now I have approximately 160.000 dimensions/features.
Be able to manage sparse matrix. ...
8
votes
3answers
149 views
Space-efficient clustering
Most clustering algorithms I've seen start with creating a each-to-each distances among all points, which becomes problematic on larger datasets. Is there one that doesn't do it? Or does it in some ...
6
votes
4answers
278 views
Clustering of large, heavy-tailed dataset
I have a dataset of 130k internet users characterized by 4 variables describing users' number of sessions, locations visited, avg data download and session time aggregated from four months of ...
