k-means is a family of cluster analysis methods in which you specify the number of clusters you expect. This is as opposed to hierarchical cluster analysis methods.

learn more… | top users | synonyms

0
votes
1answer
23 views

k-means clustering on percentages

Can we do k-means clustering on percentage data (like 56%, 44%, 22%, 13%, etc.)? There is a data set, and data in various parts are measured in percentages.
0
votes
1answer
26 views

k-means in R generates same number of clusters but different cluster label

Hi there I am running a k-means code in R with the same data and with the same number of clusters, in this case 3, but each time that I run the code, the cluster label changes, for example. In the ...
1
vote
1answer
31 views

A clustering and classification question

I'm trying to classify my set of data into two classes (introvert / extrovert). I was thinking of using a decision tree at first, but I don't have any potential known results in order to create my ...
0
votes
1answer
29 views

Classifying a set of photos to places

I want to cluster photos and map them to places. As input I have Photos with locations (lat, long) Places - some as (imprecise) bounding boxes, some just as points, maybe others as bounding ...
1
vote
2answers
43 views

clustering accuracy

I have a general doubt regarding clustering. I have a data set of size 1196*18675. where 1196 is the no of documents. I am trying to cluster the data with k=7 using k-means. Each time the clustered ...
3
votes
1answer
29 views

K-means metrics

I have read through the scikit learn documentation and Googled to no avail. I have 2000 data sets, clustered as the picture shows. Some of the clusters, as shown, are wrong, here the red cluster. I ...
0
votes
0answers
6 views

Turning MiniBatchKMeans into Fuzzy MiniBatchKMeans

I'm using Scikit-Learn, which has an implementation of MiniBatchKMeans. I'm very inexperienced with ML, so I'm wondering how (if ...
2
votes
1answer
39 views

Which clustering technique to use for a temporal dataset?

I have seen a similar question but thought I'd ask my own to hopefully garner some usefull feedback. Basically, I have a large temporal dataset, consisting of domestic smart energy meter use ...
1
vote
0answers
28 views

Avoid local minima in kmeans

Many machine learning techniques suffer from the curse of local minima, one of them is K-means. I am using a matlab script for a computer vision task. One of the first steps I do is kmeans clustering ...
0
votes
0answers
25 views

K-means Stuck in 1 cluster

I'm working on a problem using the encog Kmeans library and NO MATTER what features I add to the model, it always gets stuck in one of the clusters. ALL of the samples are lumped into one cluster ...
3
votes
1answer
57 views

Inputs to k-means are often normalized per-feature. Why not fully whiten the data instead?

We often normalize inputs to the k-means algorithm by 1) subtracting the mean on a per-feature basis and 2) dividing by the standard deviation on a per-feature basis. Some rational behind this is ...
1
vote
1answer
30 views

Assigning meaningful cluster name automatically

The objective of my work is to cluster the text documents. Once the documents are clustered, traditionally the system will assign numeric value for the clustered group. For example if I have 5 ...
1
vote
1answer
38 views

K-means cluster Analysis and 4-point Likert Scales

Is there a concern using a 4-point likert-type scale (i.e., agreement) when attempting a cluster analysis using k-means clustering? Most of the data for the items in my data set are favorable (e.g., ...
3
votes
2answers
71 views

Feature / attribute selection for k-means or other clustering

It seems to me that in literature it is assumed that one knows which features / attributes to choose to characterize an item in clustering. If I have a database with items which have many attributes, ...
0
votes
0answers
17 views

Edge Probabilty Using KL-Divergence Code in Python

Its a little complicated question, so please bear with me. I am doing Image Segmentation using Swendsen-Wang method for Image Analysis./ (stat.fsu.edu/~abarbu/papers/jcgs.pdf) I have to calculate ...
1
vote
1answer
66 views

Clustering algorithms for extremely sparse data

I am trying to cluster an extremely sparse text corpus, and I know the number of clusters (my data is the title and author list of scientific publications, for which I already know the number of ...
1
vote
0answers
45 views

Clustering on a data set with mixed variables

I have a data set consisting of $n$ elements with $d$ features for each element ($x_{i,f}$ means the value for the f-th feature of the i-th element). I would like to cluster this data set into $k$ ...
0
votes
0answers
6 views

Comparing to vectors of labels that contain different labels, but the same number, and the same places

Problem: After doing two cluster analysis, I get two arrays $V_1$ and $V_2$ of length $N$. I have a groundtruth vector as well $GT$. I want to make the comparison, which is label invariant. Say first ...
1
vote
0answers
19 views

ML Bank transactions assignement to invoices

In a effort to reduce human intervention, I'm trying to optimize the process of assigning bank transactions to invoices. This task should be done once every year, so we can assume our dataset won't ...
7
votes
3answers
366 views

Clusterings that can be caused by K-means

I have gotten the following question as a test question for my exam and I simply cannot understand the answer. A scatter plot of the data projected onto the first two principal components is shown ...
-1
votes
1answer
39 views

K-means clustering and R - what to do next?

I used kmeans command on my data-frame (as suggested in "R and Data Mining: Examples and Case studies"). Now my data is clustered into x number of cluster. What ...
0
votes
0answers
28 views

How to test the significance of clusters?

How can one test the significance of the clusters obtained after a clustering procedure? Are there separate tests for the distance/similarity/dissimilarity measure used to get the distance matrix and ...
2
votes
1answer
39 views

Intuition behind the Calinski-Harabasz Index

Given $CH(k) = [B(k) / W(k) ] \times [(n-k)/(k-1)]$, where $n$ = # data points $k$ = # clusters $W(k)$ = within cluster variation $B(k)$ = between cluster variation. It is my understanding that the ...
0
votes
1answer
50 views

Interpretation of NbClust result

The plots show the output of NbClust(). By looking at the plot, is that correct to say that k=5 is the optimal number of ...
0
votes
0answers
18 views

Square distance and likelihood in k-means

In k-means algorithm, the distance minimization step is equivalent to maximize likelihood: $P(X|\theta)$ or to maximize posterior distribution $P(\theta|X)$? I think it's more logical to maximize ...
0
votes
0answers
12 views

K-means finds less than K groups [duplicate]

According to the $K$-means algorithm, Randomly assign a group or cluster to each point. # initial step Compute the centroids of all the $K$ groups. Reassign each point to the closest groups by ...
3
votes
1answer
113 views

Bayesian Networks and discretization of variables using K-means clustering

In many approaches to learning Bayesian Networks a solution to tackle continuous variables is to discretize them and apply one of the well established techniques for learning Bayesian Networks ...
0
votes
0answers
16 views

Clustering groups that have replicated measures: hierarchical clustering on group-average VS regression tree

I measured 2 continous dependent variables (V1 and V2) on 10 occasions (10 replicates) for each of 4 groups. I aim to cluster my groups. i.e. I dont want to cluster replicates, since this could mix ...
3
votes
2answers
48 views

Is there an efficient way to discriminate space based on K-Means results?

Suppose we done K-Means and got K centroids of clusters and we want to tag new points based on those K centroids. UPDATE: These K centroids are given to me, so I can't go for another clustering ...
0
votes
1answer
136 views

usefulness of k-means clustering on high dimensional data [duplicate]

I wonder what is the usefulness of k-means clustering in high dimensional spaces, and why it can be better (or not) than other clustering methods when dealing with high dimensional spaces.
0
votes
2answers
80 views

Streaming k-means

I want to perform something like streaming/online/out-of-core kmeans clustering on large data. Here is simple idea: Break all data into N chunks. Read from disk 1st chunk and calculate centroids ...
1
vote
1answer
48 views

Alternative to spherical K-Means for clustering large high dimensional dataset

What are some alternatives to Spherical K-Means for clustering very large datasets of high dimension? I'm looking for something that will be fast even on large datasets, and preferably will not ...
1
vote
0answers
25 views

Clustering Techniques

I'm a little new to data mining and would definitely appreciate some tips. I'm using clustering algorithms looking for possible grouping in some variables described below. I've been using the Excel ...
1
vote
0answers
87 views

k-means + linear regression: How to split the data for validation

I want to cluster my data first using k-means and then determine a regression model for each cluster. Then I want to evaluate the performance of this approach using split validation. I can think of ...
0
votes
0answers
35 views

Standardizing variables for k-means?

I only have two variables and they are on the same scale. However, the variance corresponding to the first variable is approximately 0.609, whereas for the second variable is 0.154. So my question is ...
1
vote
0answers
41 views

Vector Quantization of heavy tailed distribution

I'm generating with Monte Carlo simulation some stock price $X$. Once I have the stock price sample, I want to cluster it with 100 points $\hat{X}$. My problem is that the error associate with my ...
0
votes
1answer
47 views

Can component scores be used for further analyses, e.g. cluster analysis?

I have done a principal component analysis using SPSS and now have 3 components. 2 components have 4 items in the subscale, and 1 component has 3 items. Component scores using regression for each ...
1
vote
0answers
45 views

Advice on how to analyse “customer-data” in R

consider the following example data: ...
2
votes
1answer
54 views

Finding the cluster centers in kernel k-means clustering

I think this is the most easily understood topic in Kernel K Means Clustering. But assuming that I am not an expert in Machine Learning, can someone tell me how does someone calculate Kernel K means ...
1
vote
0answers
244 views

Using BIC to estimate the number of k in KMEANS

I am currently trying to compute the BIC for my toy data set (ofc iris (: ). I want to reproduce the results as shown here (Fig. 5). That paper is also my source for the BIC formulas. I have 2 ...
0
votes
0answers
39 views

How do I cluster documents using topic models?

Let us say I have a topic probability per document, for example: ...
1
vote
0answers
39 views

Exact derivation for finding k-means from Gaussian Mixtures

I am having difficulty in deriving k-means from Mixture of Gaussians. I am following the notation from Bishop (2006), Section 9.3.2: Suppose we have : $$ p(\mathbf{x}| \boldsymbol{\mu}_k, ...
1
vote
1answer
49 views

What do you do when a centroid doesn't attract any points?

I am solving a clustering problem on a trivial dataset with the k-means algorithm. I am running a couple of tests and, from time to time, one centroid doesn't attract any points, i.e. I've got an ...
1
vote
3answers
170 views

Is it important to scale data before clustering?

I found this tutorial, which suggests that you should run the scale function on features before clustering (I believe that it converts data to z-scores). I'm wondering whether that is necessary. I'm ...
5
votes
2answers
86 views

What do you do when there's no elbow point for kmeans clustering

I've learned that when choosing a number of clusters, you should look for an elbow point for different values of K. I've plotted the values of withinss for values of k from 1 to 10, but I'm not seeing ...
1
vote
1answer
71 views

K-medians, formula to compute the median

If you are running K-medians, and your distance metric is the L1 norm, how do you derive that the center of each centroid is the median of the data points assigned to it? Second, how do you compute ...
4
votes
1answer
75 views

What algorithm should I use to cluster a huge binary dataset into few categories?

I have a large (650K rows * 62 columns) matrix of binary data (0-1 entries only). The matrix is mostly sparse: about 8% is filled. I would like to cluster it into 5 groups - say named from 1 to 5. I ...
0
votes
0answers
57 views

Modified K-means with unequal cluster variances

I wonder how I can modify the K-means algorithm so that the cluster volumes are not equal to each other. The K-means objective is to minimize within cluster sum of squares $\sum_{i=1}^{p} {\parallel ...
4
votes
1answer
50 views

gaussian mixture model - approximate a matrix

I have a similarity matrix M - the value M(i,j) indicates the similarity between two elements i and j. I want to approximate that matrix using a Gaussian Mixture model or I want to cluster that ...
0
votes
2answers
128 views

Is clustering (kmeans) appropriate for partitioning a one-dimensional array?

I want to group the outcome of a function into 2 (or 3) categories. I have a function efficiency=f(weight,speed,#refueling_stops) that takes 3 input parameters and the output tells me how "efficient" ...