Partitioning data into subsets of objects according to their mutual "similarity," without using preexisting knowledge such as class labels. Clustered-standard-errors and/or cluster-samples should be tagged as such; do not use the "clustering" tag for them.

learn more… | top users | synonyms (1)

0
votes
1answer
48 views

Learning a classifier to compute distance between points for clustering

I have dataset of items and want to cluster them. However, I don't have a predefined distance function. Does it make sense to learn a classifier that can predict the similarity between any two items? ...
0
votes
0answers
14 views

Merging linkage results from separate datasets for the purpose of clustering

Suppose I have a dataset P, This dataset is separated into smaller disjoint subsets Q_i. Since the clustering algorithm which has to be applied is space O(n2), the amount of data in P such that it ...
0
votes
1answer
24 views

How to detect noisy entries in the data set

I have a data set (entries described by the list of features X1-X7). This data set contains a small percentage of noise. How can I detect those entries that are subject to noise and exclude them from ...
0
votes
0answers
12 views

Technique to cluster with multiple dimensions

I have a data set which has respondents categorized as Tier 1, Tier 2 and Tier 3 - scores of their preferred genre of content and keywords relating to the genre. What I would like to achieve is to ...
0
votes
0answers
9 views

Bisecting K-mediods [duplicate]

Is there an algorithm like Bisecting K-mediods and what would its advantages/weaknesses be? It seems to me that it could be used well in combination of Dynamic Time Warping for clustering time ...
0
votes
1answer
31 views

Help with cluster analysis. Is this possible? [duplicate]

I'm working with the productivity of various government documents. In my data I have two variables (annual frequency and time of resolution) and each document gets its position in a Cartesian plane ...
0
votes
2answers
62 views

Bisecting K-means using Dynamic Time Warping

I'm trying to cluster time series of different length and I came up to an idea to use DTW as a similarity measure, which seems to be adequate, but the thing is, I cannot use it with K-means, since ...
0
votes
0answers
125 views

Gower's dissimilarity measure and Ward's clustering method

I have read some topics in this web side that, it is not true to use Gower's dissimilarity matrix for Ward's clustering algorithm. I have mixed type variables, first I had a dissimilarity matrix ...
0
votes
0answers
35 views

Implementing Hopkins and Cox-Lewis index in R

I was trying to implement some clustering tendency tools in R, namely the Hopkin's index and the Cox–Lewis index. Here is the link at page 901 to show what they are This is what I managed to come up ...
2
votes
0answers
23 views

Normalizing regressors in logistic space

I have a bunch of sklearn sgd models that have beta coefficients in the logistic space. I want to see if these models cluster ...
6
votes
2answers
410 views

Dynamic Time Warping Clustering

What would be the approach to use Dynamic Time Warping to perform clustering of time series? I have read about DTW as a way to find similarity between two time series, while they could be shifted in ...
-1
votes
1answer
23 views

Exploring multiple semantic clusters of a given set of terms

I have a list of N object categories(e.g. apple, cell-phone, horse, chair, watch). Are there any methods of obtaining various clusters based on attributes of these categories ? For example, one ...
0
votes
1answer
18 views

K-Means Clustering on Distributed System

Can anyone explain how the k-means clustering algorithm converges on distributed systems? It seems that each node in our hadoop cluster would simply find a local optimum. How do we update across ...
0
votes
0answers
80 views

How to use binary variables in K means/Hierarchical clustering in SAS/R?

I need to use binary variables( values 0 & 1) in K means. But K means works with only continuous variables. I know some people still use these binary variables in K means ignoring the fact that k ...
2
votes
2answers
44 views

Cluster analysis as a preliminary analysis

I want to produce four groups (high/high, high/low, low/high and low/low) using two continues variables and compare these groups in terms of a few dependent variables. I know that cluster analysis ...
1
vote
1answer
29 views

classification of the groups [duplicate]

Let's say I have two variables: height and weight. I want to produce 4 groups: high height/high weight, high height/low weight, low height/ high weight and low height/low weight. I also want to see ...
7
votes
4answers
244 views

Are there any non-distance based clustering algorithms?

It seems that for K-means and other related algorithms, clustering is based off calculating distance between points. Is there one that works without it? Thanks!
1
vote
2answers
23 views

Revealing structure of clusters in a dataset

I have obtained values for the same parameter in various locations and I want to cluster them (abundance fraction of different minerals in a hyper-spectral image). These fractions have spatial ...
0
votes
1answer
44 views

Update Rules in Expectation Maximization

I am emulating a certain PDF behaviour using a function. However, due to divergent improper integral, I don't have a closed form expression for the normalization constant. To get the PDF, I just ...
0
votes
2answers
102 views

Mahalanobis distance measure for clustering

Let's say I have a group of clusters. Would you recommend Mahalanobis distance measure for checking if new arrived data belongs to existing clusters or it is an outlier? Also, would you recommend ...
0
votes
2answers
60 views

Use of bootstrap in clustering algorithms

Are there clustering algorithms that take advantage of bootstrap? For example can one combine bootstrap with a standard K-Means algorithm to scale K-Means. I was thinking if the following at a ...
0
votes
0answers
12 views

How to segment/profile users after performing classification?

So let's say that you've used logistic regression with demographic factors to make prediction on user bebaviour (e.g. those who clicked on a particular link v those who didn't) and you are satisfied ...
0
votes
0answers
11 views

Conjoint analysis

I am planning to conduct a conjoint study, but am having problems in terms of the number of product profiles to include. I will have to interview respondents in the markets and hence wanted that the ...
0
votes
1answer
18 views

Benchmarking hard clustering results against soft clustering results (ground truth)?

Well, I don't have labels (ground truth) for my data points. However, by domain knowledge, I am certain that a particular soft clustering algorithm will produce satisfactory results. Hence, I may use ...
1
vote
2answers
89 views

Mutual information for two soft clustering results?

I understand that mutual information (MI) of two distributions $X$ and $Y$ is defined as In the case of clustering analysis, say we are looking for two clusters out of 3 data points. We have two ...
4
votes
1answer
100 views

Clustering into teams of fixed size

There is a particular team-based video game that exposes a ladder of individual ratings for each player that looks like this (player, rating, wins, losses): A, 2000, 35, 12 B, 1900, 41, 19 C, 1800, ...
1
vote
1answer
100 views

Anomaly detection: multivariate Gaussian distribution

I am trying to do anomaly detection on a heterogeneous dataset (There are unknown groups present in the dataset). I want to try multivariate Gaussian distribution based approach, but I was thinking of ...
0
votes
0answers
55 views

Find the radius of a cluster, given that its center is the average of the centers of two other clusters

I do not know if it is possible to find it, but I am using Kmeans clustering, and I am stuck to the following. In my implementation, I create with two different threads the following clusters: ...
0
votes
0answers
27 views

Clusters as input for classification

I'm currently performing clustering as a batch job and then in real time I'm assigning new points to cluster whose centroid is closest to new arrived point. The other approach that I see is to ...
3
votes
1answer
72 views

Best clustering algorithm for real estate data

I want to cluster real estate data to determine average price patterns in city and rural regions. My data set contains size, number of dorms, bathrooms and coordinates of the properties. Which would ...
0
votes
0answers
23 views

Which kind of analysis could be made to associate a set of genes to clinical values?

I have a set of 5 genes that can be mutated or not, so therefore are intended as dichotomous yes/no vars. I want to identify the effect of the mutation of this genes on a continuous response var. The ...
0
votes
0answers
13 views

Profiling high-scoring clusters in a multi-dimensional feature space

I have a large amount of samples, which have a multi-imensional feature vector associated with them. Each sample has a "score", and the length of the feature vector is substantial (n>100, and in ...
1
vote
0answers
34 views

Investigate correlation between one variable and combinations of others

We're conducting a study which correlate the incidence of various conditions during pregnancy and in newborns and the use of artificial reproduction technique (ART). This way we saw that some ...
5
votes
1answer
183 views

Clustering data into bins of variable sizes

I'd like to build a model (in R or excel) that takes in large amount of linear data and segments it into "bins". The linear data is an attribute that reflects what condition that section/record is at. ...
3
votes
0answers
53 views

Use of Hidden Markov Models for Clustering

I would like to ask whether Hidden Markov Models can be used for clustering and if so, in what cases. I have found somewhere, references like this but practically I haven't found a way to do this. Is ...
0
votes
0answers
16 views

Automatically classifying user activity/sessions on a website?

X-posted from Stack Overflow: I have a large body of records pertaining to user activity on a website. What I want to do is some sort of classification on each user as they navigate my website. Every ...
0
votes
0answers
15 views

Good mean shift clustering datasets

I am working on a modification of the Mean Shift algorithm and would like to validate my clustering results. I am struggling to find suitable clustering datasets to compare performance with. I'm ...
1
vote
0answers
75 views

Observation/case weighting in cluster analysis

Sampling weights, the inverse probability of a unit's selection into the sample, and other more complex and adjusted weights are very often used in the social sciences. There is statistical software ...
0
votes
1answer
28 views

What Grouping Method To Determine Average Over Lifetime?

I have the following data: When individual 'x' joined a company. As the data is limited to 2 years I do not know the start date of every individual. When individual 'x' left the same company. If this ...
0
votes
1answer
38 views

Cluster Sequences of data with different length

I need to cluster sequences of data that have different length. I am using Matlab and my first question is related to the method. Is KMeans sufficient to achieve this? IN KMeans I have to use the ...
0
votes
0answers
20 views

Logistic regression and cluster ID

The dataset consists of all prescriptions classified as on or off-label (0 or 1), meaning possible more than one prescription per child (pnr-number) I want to know the off-label rates per year for ...
1
vote
1answer
38 views

Hierarchical clustering: different result when I change labels

I am running hierarchical clustering with a distance matrix M_norm: hc <- hclust(M_norm^2, method = "ward.D") plot(hc, cex = 1, hang = -1) When I use ...
0
votes
0answers
27 views

Descriptive clustering of papers

Given a set of PubMed abstracts or keywords derived from MeSH terms, I would like to know how many and what topics are among them in order to write a paper review. Other information such as the number ...
0
votes
0answers
24 views

The best algorithm for short documents clustering

I have a corpus of short text documents. Each document is an automatic recognized phone conversation (a dialog) from a large call center. The texts are not clean and have lots of grammar and other ...
2
votes
1answer
77 views

A valid distance metric for high dimensional data

I asked a question about forming a valid distance metric yesterday (Link1) and got some very good answer; however, I have got some more questions about forming a proper distance metric for high ...
3
votes
1answer
37 views

Can I use k-means with a distance matrix composed of percentages? [duplicate]

I have objects o1, o2,...,on and for each pair I calculate a value that measures the pair's difference. This is a percentage, so for example o1o2 differ by 56%. Now I want to cluster this data. I can ...
1
vote
3answers
81 views

How to get a valid distance metric?

I have got a problem to devise a distance metric to get the similarity measurement of vectors. Someone suggested me to use dot product, which seems to me the same as the Cosine similarity metric; ...
0
votes
0answers
77 views

INTRA-cluster and inter-cluster distance

Thank you for your reply I have generated a valid partition using the following code IDX = kmeans(data(:, 1:end-1),k,'replicates',10,'EmptyAction','drop'); and I am comparing the intra and ...
0
votes
0answers
6 views

The authenticity of the N-cut measure when the number of components in the data is high

I'm running a clustering task on unlabeled data, and assume we're validating our results by applying the Min-Cut measure as an internal validity index. Let's refer the normalized version of the ...
1
vote
0answers
51 views

clustering vs fitting with a distribution

I have a question about using a clustering method vs fitting the same data with a distribution. Assuming that I have a dataset with 2 features (feat_A and feat_B) and let's assume that I use a ...