Partitioning data into subsets of objects according to their mutual "similarity," without using preexisting knowledge such as class labels. Clustered-standard-errors and/or cluster-samples should be tagged as such; do not use the "clustering" tag for them.

learn more… | top users | synonyms (1)

0
votes
0answers
10 views

Dirichlet process mixture model in Python

My question is concerned with the practical issues of using this model. I've tried to use Dirichlet process mixture model from Scikit learn python package to find a number of clusters in my data (1D ...
0
votes
0answers
28 views

How to represent outliers for multi dimensional data (local outlier factor)

Below graph taken from http://en.wikipedia.org/wiki/Local_outlier_factor displays "LOF scores : LOF image : This is great for two dimensional data but what about data > than two dimensions. How ...
1
vote
1answer
38 views

How to evaluate a clustering/unsupervised learning problem with massive amounts of data, with labels only for a small fraction of points

I'm wondering if anybody can point me to work on the evaluation of unsupervised learning where there are a very large (say hundreds of millions) number of points and manual labelling can only ever be ...
0
votes
1answer
12 views

How can one evaluate Incremental Clustering Algorithms, in particular the goodness of the clusters formed?

I have been studying an incremental clustering algorithm for a large set of data that exhibit an inherent dynamic behavior (that is new data can get added over time and some older data may get deleted ...
0
votes
1answer
15 views

Generating even-sized clusters in scikit-learn [duplicate]

I'm attempting to generate approximately even-sized clusters of a PCA'd feature set in Scikit-learn, but I'm not having any luck. I'm only familiar with KMeans clustering, and with that algorithm the ...
0
votes
0answers
23 views

Statistical significance of cluster validity

Hi I m working on a unsupervised problem to partition my dataset. I have access to the class labels for this dataset. Now I am trying to use Jaccard coefficient to compute correlation between cluster ...
1
vote
0answers
20 views

Spatial cluster analysis

Let's say I have a structure like this : This is a spatial region with measurement of plant population in each site. Black and red represent two regions with different intensities.The question is ...
0
votes
1answer
24 views

Cluster migration visualization

I have asked a very similar question at the Latex forum here, but in order to address the part of my question where I ask if there is a better way of visualizing the data I have, I wanted to cross ...
0
votes
2answers
27 views

Kmeans cluster size change quite a bit on each run

I am running a kmeans on a sample size of 1000 data. The data is scaled (z). When I run kmeans(df, nstart=25, centers=5)- it runs and I can get the size of each cluster. The largest group has 620 in ...
2
votes
0answers
19 views

Heteroskedasticity in a Linear Mixed Model SAS PROC MIXED

Asked a version of this question before but realized it needed some clarification. I have a dataset with identical twin pairs and fraternal twin pairs. I want to examine the relationship between an ...
0
votes
0answers
16 views

Cluster analysis (proximities)

I have a question regarding clustering. I have a symmetric matrix of 50 specialties (50 X 50) where each cell represents the number of observations related to each combination of specialties. Some ...
1
vote
0answers
17 views

Kmeans plotting on discriminant components

When you plot a kmeans model (in R) with the plotcluster() function, it plots the clusters against the axis of the 1st and 2nd discriminant components (dc). In reading about these axis- some state ...
0
votes
0answers
24 views

How to do clustering using genetic algorithm?

I am studying how to use genetic algorithm (GA) in clustering analysis on R programming. What I understand now is that we have to determine fitness function in GA. That is, we have to minimize within ...
0
votes
0answers
32 views

Variable Clustering Analysis

I have a data set that consists of 143 variables (~11000 observations), and I wish to do variable clustering to reduce the dimension. I am using hclustvar function ...
0
votes
1answer
27 views

Autoclass in R/Python? [closed]

Are there any packages that implement the Autoclass/ Naive Bayes Clustering algorithm in R or Python? Alternatively, what are some other clustering algorithms that can handle both categorical and ...
0
votes
2answers
22 views

How to propositionalize a relational data set for clustering analysis?

I am working with a data set of students and their courses for a single semester, attempting to cluster based on the courses & various other attributes where "courses" are the "many" side of a ...
-1
votes
0answers
16 views

Clustering using different distance measures [duplicate]

I do unsupervised clustering for a dataset using k-means algorithm. I want to know what is the difference between different distance measures (Euclidean, cityblock, cosine and correlation,...etc). I ...
0
votes
0answers
52 views

PCA scores and cluster analysis

I have obtained PCA scores (Anderson-Rubin) and thought to use them in cluster analysis, but have got confused how to make interpretations based on them or as what type of variable they should be ...
0
votes
1answer
24 views

How to include noise in clustering evaluation?

When evaluating clustering methods which do have a definition for noise points (like dbscan), how noise will affect evaluation? Consider a clean dataset like well known Iris dataset. There is no ...
1
vote
2answers
28 views

How to compare two clusterings generated by two clustering approaches

I am currently working on a modification of a clustering algorithm to suit my problem domain. I want to know which methods are available for me to compare the centroids generated from the two ...
0
votes
0answers
19 views

Interpreting R results, are the data multivariate normal?

I ran "mvn" using the "mclust" package in R using the following codes: mvn("EEE", data[,18:22], prior = NULL, warn= NULL) I am having trouble figuring out how to ...
1
vote
1answer
29 views

Testing the hypothesis on clustering

I have a number of samples. For each, there is a time course of multivariate data defined, with $t$ timepoints ($t < 50$) and $n$ variables ($n > 100$). We have noted that the time courses of a ...
0
votes
1answer
34 views

Comparing mclust() and k-means centroids

I have some code that looks for clusters in x,y data. To check the number of clusters I use, I want to get the BIC. This is not possible (easily) using kmeans(), ...
0
votes
0answers
40 views

why Hierarchical Clustering pvclust vs. hclust got different result?

I am performing the hierarchical clustering analysis on a dataset of 25 viral populations using 3 viral components (variables) to construct a dendrogram with average method and correlation distance ...
0
votes
1answer
36 views

R codes for variation of information criterion using “mclust”

I am developing model-based clustering. First, I developed model-based clustering in R using "mclust." Next, I wanted to take 75% of the sample, re-run model-based clustering and compare the ...
0
votes
0answers
20 views

Appropriate PCA/ EFA rotation method

Question about appropriate PCA/ EFA rotation method. While I see that oblique rotation methods (e.g. promax) are suggested for correlated data (and I have correlated data) I see that the majority of ...
0
votes
0answers
41 views

Cluster Matching/comparison

Description I have several datasets(from different subjects) with the same type of data. For each dataset I cluster the data using affinity propagation. Clustering is based on similarity distance ...
1
vote
1answer
28 views

Binomial data and PCA and cluster analysis

I have obtained responses on around 48 items measuring employer attractiveness. The goal of my analysis is to cluster respondents according to these employer attractiveness dimensions. I plan to ...
0
votes
0answers
9 views

Streaming k means clustering Mahout

First of all, excuse me if this is not a good place to ask this question. Can anyone explain to me how streaming kmeans algorithm implemented in Mahout works? And can it be used for anomaly ...
0
votes
0answers
13 views

Term to Describe Strongly Clustered Data

I have some data which are strongly gathered into more than one cluster. I am looking for a term to effectively describe this phenomenon: e.g., multi-clustered data, which however seems to me that we ...
0
votes
1answer
18 views

Correlation or clustering of continuous score and discrete variable states

I have an experiment that produces a decimal score representing quality, and a bunch (5-30) of variables that each take on one of a set of discrete states. - The states are not meaningfully ...
0
votes
1answer
29 views

How can I determine local minima from a Kernel Density Estimation? [duplicate]

I have a fairly large 1-dimensional array that I am trying to cluster. I came across several other questions on this site where the top answer is to use a Kernel Density Estimation and then locate ...
0
votes
1answer
26 views

Mixing probabilities in mixture models using EM

Assume we want to estimate the mixing probabilities ($\pi_{k}$) for each member distribution in the mixture model. We know that $\sum_{m}^{K}\pi_{m}=1$, so we can formulate the optimization problem ...
4
votes
2answers
79 views

Using k-means with other metrics

So I realize this has been asked before: e.g. What are the use cases related to cluster analysis of different distance metrics? but I've found the answers somewhat contradictory to what is suggested ...
0
votes
0answers
22 views

breakpoint analyses on multiple series: how to detect common points

I have 20 time series that span the same period (100 days each), from 4 species sampled at 5 different location. I made a loop to perform a breakpoint analysis on all of them, resulting in 0 to 3 ...
0
votes
1answer
42 views

How to Calculate silhouette coefficient in SPSS for clustered data set?

I am having a pre clustered dataset with data and the action cluster identified for it using a custom clustering method. I am looking to calculate silhouette coefficient on this clustered dataset ...
0
votes
2answers
46 views

What's a good way to mentally visualize n dimensions in a k means

I've been using k-means to do some clustering and one of the ideas I'm struggling with is the n dimensions aspect. If I were clustering housing prices vs sq. feet its just a simple 2d graph. That I ...
0
votes
1answer
24 views

Is my understanding of how to calculate the reachability distance in local outlier factor correct?

Reading lof implementation at : http://www.cse.ust.hk/~leichen/courses/msc-it5210/lectures/LOF_Example.pdf the local reachability distance is given as : I don't fully understand this equation as ...
0
votes
0answers
7 views

Clustering techniques when there are two distinct but numerically similar clusters among others

I'm trying to cluster some spatial statistics for some behavioral estimation. However, parts of the trajectory report exactly 0 speed, which implies some kind of resting state which is different from ...
1
vote
1answer
14 views

Why is it called Epsilon for DBSCAN?

The two parameters of DBSCAN are epsilon and minimum samples. Shouldn't epsilon be called like "Circle radius"? Why is it called epsilon?
0
votes
0answers
23 views

How to measure the similarity of k-means clustering using different datasets?

I run k-means clustering on my dataset (100 samples in total) and partition the data into k=5 clusters. Then I want to test how robust of the k-means can be; however, I haven't got more new data ...
0
votes
0answers
8 views

automatic assign class name based on text

My question is , I have a set of plain text , i want to create category based on the text. Eg: i have written something about Soup recepie then the algorithm must create a category called Food. After ...
0
votes
0answers
18 views

Need a rigorous statistical framework for automating visualization

I am faced with a challenging problem. Suppose I have a large dataset with many attributes and I can filter the data using a set of attributes. The problem is in the event we have a large number of ...
2
votes
0answers
38 views

Order and similarity measurement

Let's say I have 10 different groups, and each group has its own string sequence. So, it should be like: ...
0
votes
0answers
22 views

How can I evaluate the accuracy of a clustering when I don't have information on the true class labels?

Already classified data set for the t-shirt factory problem I want to calculate the accuracy of my algorithm. I have the training data without any size information and I couldn't find the classified ...
0
votes
0answers
45 views

Clustering method that can use graph links, discrete and continuous properties?

I have an un-weighted, directed graph that clusters ok using MCL or other graph clustering algorithms. However, I also have additional discrete and continuous properties of the nodes being clustered ...
2
votes
0answers
28 views

Co-occurrence statistics for sets

I am looking for help in the following situation: I have a set of numbers $A=\{1, 2, \dots, 100\}$, and I am drawing subsets of 10 of these numbers $\{a_1, a_2, \dots, a_{10}\}$ according to an ...
2
votes
2answers
90 views

How does one go about clustering data?

(I have updated the question following conversation with @whuber in the comments). My case is as follows: I have around one thousand row vectors of dimension $1 \times 8$. These row vectors are ...
0
votes
1answer
25 views

How many factors should be used for a cluster analysis?

I have a short question. I've performed a principal component analysis and obtained two components. Are two components enough two perform a cluster analysis (number of participants > 400)? Thanks for ...
0
votes
1answer
57 views

How to determine which variable or combination of the variables are affecting to the predictor variable?

I have one dependent variable name as "win ration" of the deal contested and more than 30 independent variables, all are categorical variable name as role of the customer, geo, region, and 27 ...