All Questions
34 questions
0
votes
0
answers
19
views
Clustering Mixed Data Types: Algorithm Selection, Distance Measurement, and Feature Weighting
I have a database of 74,000 records with 29 features. Fourteen of these features are categorical and are either 0 or 1, while the other 15 features are continuous and have been normalized and scaled ...
1
vote
1
answer
59
views
Elbow method not giving a proper curve in python code
I am trying to determine how many clusters to use for my k-means clustering using different methods.
first i used the following code to calculate different metrics per cluster number and different ...
- 11
4
votes
2
answers
409
views
Question about Silhouette index calculation using scikit
I am currently working with continuous data measured from different sensors (thermometers and voltmeters). I have a matrix whose columns represent the sensors and the rows are normalized measurements (...
- 205
1
vote
1
answer
110
views
How to tell whether segments from K Means clustering result are "successful" and will impact business metrics?
Background
I'm a data analyst. The Business unit I'm assigned for needs to segment users based on power vs non-power users so they can target each segment with proper treatments.
Goal
Segment users (...
- 135
1
vote
1
answer
1k
views
Elbow method Vs Gap statistics, which one? challenging for data scientist
I am working on hourly-weather data. It contains four features: rain, wind speed, humidity, and temperature. Obviously, all of them are continuous values. The number of records is around 17000. Other ...
- 73
0
votes
1
answer
108
views
Time Series clustering: clustering a dictionary of time series
I'm working on classifying times series to find clear pattern of use. My data is collected from clients of a telecom company, and we want to detect pattern of the amount of data consumed by clients ...
0
votes
0
answers
78
views
cluster 2d matrix (clustring)
i have a 2d Matrix and It contains specifications for laptops, where each group contains three components like thant :
...
1
vote
1
answer
346
views
Clustering Data with Time and ~10 million records
I have a dataset with features like product categories, their dimensions, price, units sold on a given day.
I want to create clusters out of this dataset (~12-15 million records) and I am using data ...
1
vote
1
answer
376
views
standardization/normalization for 1D clustering?
I have two input variables revenue and age. Am trying to find different bins within that variables.
For ex: I have ...
- 3,342
0
votes
1
answer
2k
views
How to evaluate unsupervised Anomaly Detection using k-means
I'm trying out different anomaly detection models and would love to hear opinion on my idea from somebody experienced. My goal is to perform anomaly detection with different models and to give each ...
- 3
2
votes
2
answers
179
views
How to find the number of clusters when more than one datasets are aggregated as one?
Suppose 3 datasets has 3 ,7, 4 clusters in their respective dataset.
When I aggregated them as one dataset what's the safest number of cluster to choose as perimeter for kmeans or any supervised ...
- 23
1
vote
1
answer
96
views
Find all possible clusterizations
I need help to find all possible clusterizations via the k-means method in Python. Let's assume for simplicity that I have the following table:
height | weight | country of origin (X/Y/Z) | flag (1/0)
...
- 131
1
vote
2
answers
595
views
K-Means output the similar to each other cluster
I am trying to run K-Means on my data set of house price prediction problem.
After running it, the output of the model seems wrong because the graphs look the same as each other.
This is my code:
<...
- 113
0
votes
1
answer
199
views
How to evaluate the perforamance of clustering model using python
I have implemented the k means clustering model using python , i would like to know whether my model is perfect or not , so that i want to know which performance metrics is used for clustering model ...
- 23
0
votes
0
answers
232
views
Which is the best clustering algorithm for clustering multidimensional data with low density difference?
I am working on a project currently and I wish to cluster multi-dimensional data. I tried K-Means clustering and DBSCAN clustering, both being completely different algorithms.
The K-Means model ...
0
votes
1
answer
85
views
Visualize Analysis of clustering after pca
I am using kmeans for clustering and if I read the topics around here and somewhere else it is always recommended to do a graphical check-up for the number of ...
- 236
1
vote
1
answer
358
views
Should I scale when clustering text data using K-means?
I want to cluster a folder of texts. I created a data file where for each text, I write whether a certain word appears in it or not. I want to cluster according to this.
So my matrix is globally only ...
- 363
1
vote
1
answer
151
views
Modifying k-means for points on torus
My data coordinates are degrees so each axis has values [-180, 180]. Therefore it's easy to spot that in fact the scatter plot on the right end continues on the left side and the same thing for up and ...
- 61
0
votes
2
answers
654
views
K-means which normalization fits
Hi am working on a business dataset, where I want to group the participant in k-means based on some features.
The problem is I have to create this features upfront, so that I combine different ...
- 236
0
votes
1
answer
526
views
How to interpret the different cluster sizes in Silhouette plot?
I created silhouette plots for my clustering models by following: this link
I want to know what does the different cluster sizes mean and how they were generated?? I understand that thicker size ...
- 141
0
votes
1
answer
154
views
k-means clustering issue voice data
I'm getting an issue in my k-means I don't know if it my data-set or what anything else.
Why i got thia flowing point in the right side of the image?
...
- 115
0
votes
0
answers
252
views
Using k-means clustering to train radial basis neural network for highly imbalanced dataset
I am trying to find prototype neurons for my radial basis neural network. My dataset has 30 attributes (of which 28 of them are the result of a single PCA) and 300.000 observations. It is a binary ...
- 3
1
vote
2
answers
4k
views
Comparing K-Means and Expectation Maximization on the dataset generated - When does K-Means perform better?
I was experimenting with K-Means and Gaussian Mixture Models (Expectation-Maximization) on the data set that I generated. Here is how the plot for two distributions looks like:
Since this was ...
- 159
0
votes
1
answer
10k
views
Calculating clusters Entropy, Python
I ran K-means++ algorithm (Python scikit-learn) to find clusters in my data (containing 5 numeric parameters).
I need to calculate the Entropy. As far as I understood, in order to calculate the ...
- 141
0
votes
0
answers
252
views
Theano K Means with Shared Variables and Scan
I have a pet project to reproduce some common clustering in theano in order to improve my understanding for future projects. I was wondering if anyone has ever used nested theano scans on shared ...
- 1
3
votes
0
answers
342
views
How to deal with variability in clustering. Multiple/Meta clustering?
I'm not sure what information is relevant here, so here is some background:
I'm using Python 3 / sklearn, but I could probably use R if needed.
I have a small sparse data-set (~1500 samples, ~1600 ...
- 191
2
votes
0
answers
420
views
A problem with implementing PCA-guided k-means
I am new to machine learning. I am reading the papers K-means Clustering via Principal Component Analysis and PCA-guided search for K-means. But there are too many mathematical proofs in these papers. ...
- 21
0
votes
1
answer
2k
views
How to cluster an 1-D array by K-means or any other algorithm using scikit-learn? [closed]
I have an one dimensional toy array X.
I want to cluster the data into some numbers of clusters.But when I try to fit my data in scikit-learn K-Means function it shows
ValueError: n_samples=1 ...
- 105
1
vote
1
answer
3k
views
K-Means Clustering Not Working As Expcected
I have a script that I'm testing with in Python3 with Scikit to cluster terms based on either words or character n-grams. Basically, it's fed a list of training data with corresponding labels. For ...
- 205
0
votes
0
answers
1k
views
What could cause a K-means clustering algorithm to converge into a single cluster?
I am currently writing a K-means clustering algorithm in Python, and I seem to have coded myself into a corner... I begin my algorithm with data sets assigned randomly to the appropriate number of K ...
- 1
35
votes
4
answers
50k
views
Clustering a correlation matrix
I have a correlation matrix which states how every item is correlated to the other item. Hence for a N items, I already have a N*N correlation matrix. Using this correlation matrix how do I cluster ...
- 483
12
votes
1
answer
32k
views
Clustering inertia formula in scikit learn
I would like to code a kmeans clustering in python using pandas and scikit learn. In order to select the good k, I would like to code the Gap Statistic from Tibshirani and al 2001 (pdf).
I would like ...
- 812
2
votes
2
answers
2k
views
Image Clustering with K-means - Postprocessing
I did some clustering on an image (each pixel is an observation that has 5 variables associated with it), I get pretty detailed results but they are a little bit noisey... I think. I used K-means. ...
- 3,875
5
votes
1
answer
812
views
How do I weight words in title, body text, and links differently in document clustering?
I'm currently trying to play around with NLTK and scikits-learn for text clustering news articles.
How do I extend the models to add the scaling of features from a document (I'm doing some ...
- 51