Skip to main content

All Questions

Filter by
Sorted by
Tagged with
0 votes
0 answers
24 views

Curse of dimensionality in Time series with K-means

I have been looking at the following notebook: time series clustering where the writer says that the dataset is affected by the "Curse of Dimensionality", so applying TimeSeriesKMeans ...
Zackbord's user avatar
0 votes
1 answer
153 views

Applying clustering algorithms after t-SNE in R

So I'm doing my bachelor`s work and I'm applying different clustering algorithms on certain data. Before all the clustering of course I'm using a dimensionality reduction algorithm such as t-SNE for ...
user avatar
1 vote
1 answer
140 views

In $k$-means, how is it NP-hard if the dimensionality of the data is at least $2$ ($d\geq 2$)?

In $k$-means, how is it NP-hard if the dimensionality of the data is at least $2$ ($d\geq 2$)? Can someone justify or give reasons to this statement? Any guidance would be appreciated.
Maryam Faheem's user avatar
1 vote
1 answer
2k views

How would one use Voronoi diagrams for KMeans for high dimensional data?

I am reading Aurelien Geron's Hands on Machine Learning, and in the Unsupervised learning chapter he demonstrates how to create a Voronoi diagram after performing K-Means clustering, and produces the ...
An Ignorant Wanderer's user avatar
1 vote
1 answer
108 views

Correct clustering approach for segmenting stores

Domain : Retail I have a set of stores which I want to cluster into similar stores based on 10 variables: revenue, avg income, market share etc. I took 2 approach: Approach 1: Given there are 10 ...
bakas's user avatar
  • 163
1 vote
2 answers
671 views

How to plot High Dimensional supervised K-means on a 2D plot chart

I'm Having a ML problem where my data set contains 80 features labelled into 3 groups (0, 1, -1). I want to plot the data on a 2D surface to see how "close" (similar) data with ...
Eran Moshe's user avatar
0 votes
0 answers
273 views

K-means: why reduce dimensions first? [duplicate]

I'm a bit confused about the usefulness of reducing dimensions before doing a k-means clustering. Suppose you want to apply k-means to a set points $(x_i)$ with high dimension. You want to minimize ...
Benoit Sanchez's user avatar
12 votes
3 answers
13k views

Clustering as dimensionality reduction

I'm reading a book "Machine learning with Spark" by Nick Pentreath, and at page 224-225 the author discusses about using K-means as a form of dimensionality reduction. I have never seen this kind of ...
ahstat's user avatar
  • 1,260
1 vote
2 answers
4k views

What should be the optimum number of features for 10 million observations for kmeans clustering?

I have a dataset of 10 million observations and 100 million features. I have to perform kmeans clustering on that dataset. The approx value of k is 30000 Is it advisable to perform clustering with ...
Rahul's user avatar
  • 11
2 votes
2 answers
900 views

Cluster centroids vs PCA as a preprocessing stage

What are the pros and cons of using K-means centroids (using cluster centroids as samples) vs Principal Component Analysis (PCA) as a preprocessing stage in machine learning? In what situation is ...
Aizzaac's user avatar
  • 1,179
10 votes
2 answers
2k views

Understanding this PCA plot of ice cream sales vs temperature

I'm taking a dummy data of temperature vs Ice cream Sales and categorized it using K Means (n clusters = 2) to distinguish 2 categories (totally dummy). Now I'm doing a Principal Component Analysis ...
adhg's user avatar
  • 569
2 votes
1 answer
662 views

Is it problematic to include negatively correlated variables in a K-Means estimator?

I'm running a simple K-Means clustering algorithm on a dataset with ~15 features. Some of the features I'm currently including in my model represent different percentages of the same whole. I'd prefer ...
Timi Bennatan's user avatar
39 votes
2 answers
57k views

How would PCA help with a k-means clustering analysis?

Background: I want to classify the residential areas of a city into groups based on their social-economic characteristics, including housing unit density, population density, green space area, housing ...
enaJ's user avatar
  • 605
1 vote
1 answer
997 views

Noise in clustering of high dimensional sparse data

Questions: 1) How to detect noise variables in high dimensional data? 2) Does the method that is presented below make sense? 3) What clustering methods are most insensitive to random variables in data?...
Tomek Tarczynski's user avatar
2 votes
2 answers
1k views

Evaluation of k-means output for >3D

I'm implementing the k-means algorithm (in R Map-Reduce) and I wanted to verify if the output I'm getting is close enough to the true centroids of the cluster. This is how I'm verifying with a 2D ...
Prateek Kulkarni's user avatar