Tagged Questions

Partitioning data into subsets of objects according to their mutual "similarity," without using preexisting knowledge such as class labels. Clustered-standard-errors and/or cluster-samples should be tagged as such; do not use the "clustering" tag for them.

learn more… | top users | synonyms (1)

0
votes
1answer
83 views

How to Calculate silhouette coefficient in SPSS for clustered data set?

I am having a pre clustered dataset with data and the action cluster identified for it using a custom clustering method. I am looking to calculate silhouette coefficient on this clustered dataset ...
0
votes
2answers
49 views

What's a good way to mentally visualize n dimensions in a k means

I've been using k-means to do some clustering and one of the ideas I'm struggling with is the n dimensions aspect. If I were clustering housing prices vs sq. feet its just a simple 2d graph. That I ...
0
votes
1answer
32 views

Is my understanding of how to calculate the reachability distance in local outlier factor correct?

Reading lof implementation at : http://www.cse.ust.hk/~leichen/courses/msc-it5210/lectures/LOF_Example.pdf the local reachability distance is given as : I don't fully understand this equation as ...
0
votes
0answers
7 views

Clustering techniques when there are two distinct but numerically similar clusters among others

I'm trying to cluster some spatial statistics for some behavioral estimation. However, parts of the trajectory report exactly 0 speed, which implies some kind of resting state which is different from ...
1
vote
1answer
17 views

Why is it called Epsilon for DBSCAN?

The two parameters of DBSCAN are epsilon and minimum samples. Shouldn't epsilon be called like "Circle radius"? Why is it called epsilon?
0
votes
0answers
28 views

How to measure the similarity of k-means clustering using different datasets?

I run k-means clustering on my dataset (100 samples in total) and partition the data into k=5 clusters. Then I want to test how robust of the k-means can be; however, I haven't got more new data ...
0
votes
0answers
8 views

automatic assign class name based on text

My question is , I have a set of plain text , i want to create category based on the text. Eg: i have written something about Soup recepie then the algorithm must create a category called Food. After ...
0
votes
0answers
19 views

Need a rigorous statistical framework for automating visualization

I am faced with a challenging problem. Suppose I have a large dataset with many attributes and I can filter the data using a set of attributes. The problem is in the event we have a large number of ...
2
votes
0answers
55 views

Order and similarity measurement

Let's say I have 10 different groups, and each group has its own string sequence. So, it should be like: ...
0
votes
0answers
26 views

How can I evaluate the accuracy of a clustering when I don't have information on the true class labels?

Already classified data set for the t-shirt factory problem I want to calculate the accuracy of my algorithm. I have the training data without any size information and I couldn't find the classified ...
0
votes
0answers
46 views

Clustering method that can use graph links, discrete and continuous properties?

I have an un-weighted, directed graph that clusters ok using MCL or other graph clustering algorithms. However, I also have additional discrete and continuous properties of the nodes being clustered ...
2
votes
0answers
28 views

Co-occurrence statistics for sets

I am looking for help in the following situation: I have a set of numbers $A=\{1, 2, \dots, 100\}$, and I am drawing subsets of 10 of these numbers $\{a_1, a_2, \dots, a_{10}\}$ according to an ...
2
votes
2answers
95 views

How does one go about clustering data?

(I have updated the question following conversation with @whuber in the comments). My case is as follows: I have around one thousand row vectors of dimension $1 \times 8$. These row vectors are ...
0
votes
1answer
25 views

How many factors should be used for a cluster analysis?

I have a short question. I've performed a principal component analysis and obtained two components. Are two components enough two perform a cluster analysis (number of participants > 400)? Thanks for ...
0
votes
1answer
63 views

How to determine which variable or combination of the variables are affecting to the predictor variable?

I have one dependent variable name as "win ration" of the deal contested and more than 30 independent variables, all are categorical variable name as role of the customer, geo, region, and 27 ...
0
votes
1answer
52 views

NbClust package r error

I try to do: NbClust(city, diss =d, distance = NULL, min.nc = 2, max.nc =5,method = "kmeans", index = "all", alphaBeale = 0.1) with city is a list of number ...
4
votes
1answer
116 views

how to discard values that are far from center of cluster in mixture model

I am trying to fit a bivariate cluster model with X and Y. What I would like to do is discard (make not clustered / un-grouped) that are far from the cluster center (for example $\mu$ + 2*standard ...
0
votes
0answers
22 views

Hierarchical clustering of repeated measures in a few locations

I have a water quality data (value) measured 10 times (every month - data) on three depths (shallow, medium, deep) in five location (A, B, C, D, E): I want to find in which location values are ...
0
votes
1answer
29 views

Clustering Two Variables With Disease Information

I was proposed a problem and I am not quite sure how to go about it. The problem is I want to find a relationship between two variables. For the simplified case there are only two variables, lets say ...
2
votes
2answers
57 views

How to fit mixture model for clustering

I have two variables - X and Y and I need to make cluster maximum (and optimal) = 5. Let's ideal plot of variables is like following: I would like to make 5 clusters of this. Something like this: ...
0
votes
1answer
64 views

Spherical K-means Clustering in R

I have a large data set that I would like to cluster using spherical K means algorithm. However, I am relatively new to this subject and R in general. Most of my knowledge is self taught and I am ...
4
votes
1answer
42 views

how to complement the results of cluster analysis with known groups

I have some prior knowledge of grouping, but this may be incorrect or is not sufficient as I need larger number of groups (i.e. subgroups). For example in the following data I have 3 groups in ...
6
votes
2answers
169 views

Clustering a noisy data or with outliers

I have a noisy data of two variables like this. ...
1
vote
1answer
134 views

What are basic differences between Kernel Approaches to Unsupervised and Supervised Machine Learning

I got nice graphical representation of Machine learning for clustering / classification. Source: Kernel Approaches to Unsupervised and Supervised Machine Learning by Sun-Yuan Kung Here are my ...
-1
votes
1answer
31 views

Weighting related attributes in hierarchical clustering

I have two questions about output of hierarchical clustering and improving the output. I'm trying to learn more about performing hierarchical clustering in R so I started looking at a simple dataset ...
0
votes
0answers
11 views

How to implement optimal scaling of categorical variables for fuzzy clustering?

I am referring this paper "Fuzzy e-Means Clustering of Mixed Databases Including Numerical and Nominal Variables" from IEEE for implementation and learning. Kindly correct my understanding so far: ...
0
votes
0answers
60 views

How is predictor importance in a cluster analysis (in SPSS) affected by dichotomy and multicollinearity?

I want to use a cluster analysis (CA) in SPSS to define different profiles in my dataset. I am using different continuous variables for this, including several neuropsychiatric measures. I am new in ...
0
votes
0answers
93 views

I find very different results using a k-means or two-step clustering method. How is this?

I want to use a cluster analysis (CA) in SPSS to define different profiles in my dataset. I am using different continuous variables for this, including several neuropsychiatric measures. I am new in ...
1
vote
1answer
91 views

calculating probability or filtering that certain subject is not in the particular cluster

I have a situation where there are n individuals and p features (variables). I do have their cluster information. Here is an example: ...
2
votes
2answers
261 views

What algorithm does ward.D in hclust() implement if it is not Ward's criteria?

The one used by option "ward.D" (equivalent to the only Ward option "ward" in R versions <= 3.0.3) does not implement Ward's (1963) clustering criterion, whereas option "ward.D2" implements ...
1
vote
1answer
33 views

How can I make clusters with highly right skewed data?

My histogram of expected income is as below. As you can see, income is highly right skewed. I want to divide individuals with regard to income - for example into Low, Middle, and High, and then I ...
0
votes
0answers
49 views

Profile variable in collaborative filtering

I'm trying to create a recommendation system based on purchases. I did some tests and I found that for some groups of customers, the recommender works very well, but not for others. How can I ...
1
vote
1answer
31 views

Clustering spherical-shaped data

I have a data set that consists of census data (5 attributes). Performing PCA, I found that the original data looks like a big chunk (please look at the first picture), and therefore, I decided to use ...
1
vote
1answer
33 views

Finding optimal combination of parameters for clustering

I have a spreadsheet with one object per line. Each column contains values that are parameters of my objects (let's say length, width, height, weight, color). I can classify objects based on color and ...
1
vote
2answers
69 views

K means clustering inadequate in determining extreme regions in R

I want to identify the regions that are considerably higher than the highest cluster. (The obvious regions which should be identified as their own clusters, notably at the x coordinate ~10 e+07. How ...
0
votes
2answers
29 views

Suggestion for discovering inherent patterns in data

I have a a big data set of clients with all sorts of variables that describe their background, payment history, and more... I also have a subset of those client who all have portrayed similar ...
0
votes
1answer
48 views

identify different points [closed]

I have a large scatterplot, with about 100,000 (x,y) points. The x coordinate is the set of numbers from (1 to ~100,000) - in other words, no 2 points have the same x-coordinate. The y is mostly ...
1
vote
3answers
34 views

Computing Image Similarity based on Color Distribution

Image Similarity based on Color Palette Distribution I am trying to compute similarity between two images based on their color palette distribution, let's say I have two sets of key value pairs as ...
1
vote
1answer
60 views

How to choose the right distance matrix for clustering?

I am attempting simple Ward type clustering. However, the R package is proving several choices to use for the distance matrix. I am wondering how I am supposed to determine the right distance matrix ...
1
vote
2answers
214 views

k-means vs k-median?

I know there is k-means clustering algorithm and k-median. One that uses the mean as the center of the cluster and the other uses the median. My question is: when/where to use which?
0
votes
0answers
7 views

Finding correlation of attributes based on known decisions

If there are two matrix of data, rows are all a person (under 50 users). In the first dataset, columns are attributes (over 500 columns) of a user with the rating 0 for does not exist, 1 for exist. ...
0
votes
1answer
49 views

How to test for correlation between frequency of an event and the stock market

I am currently running an event study, for which I need to find out if my events are clustered and/or if their frequency is tied to the stock market. Creating a scatter plot of the event dates and the ...
1
vote
0answers
22 views

clustering for histogram shapes

I am trying to get a start on a clustering problem. The sample data is trade volume at a particular price. Some notes about the data: number of bins vary from sample to sample (larger price range ...
4
votes
3answers
154 views

K-means cluster analysis with K=2 as a binary classifier

I used two variables, height and weight, and using K-means cluster analysis with $K=2$, two clusters were obtained. I used $K=2$, as the observations either belong to men or women. I then compared the ...
0
votes
1answer
111 views

Clustering high dimensional data (p > n) in R

I have a situation where we have a number of quantitative features / variables (p) than the number of samples (n). My objective is to classify these samples into groups (may be hierarchical). I can ...
2
votes
1answer
39 views

One-class Classification of multidimensional vectors

I have a m x k User-feature matrix (m >> k) obtained by factorizing an original User-websites matrix (m x n) that has #page views as entries. Additionally, there are users (say r) who have been ...
-1
votes
1answer
35 views

Metrics for cluster evaluation

I make a set of clusters using some clustering algorithm. Precision, Recall, F Measure, Fallout and RI of individual clusters are calculated for testing the performance. How do I calculate the average ...
1
vote
1answer
43 views

Creating a cluster analysis on multiple variables

I am working on creating a cluster analysis for some very basic data in r for Windows [Version 6.1.76]. The groups themselves are countries and then I have 2 column with continuous numerical ...
0
votes
1answer
136 views

hclust, R and Euclidean distances: weird stuff

I have a table of similarities expressed through cosines and am trying to do some cluster analysis in R, using hclust and ...
0
votes
0answers
100 views

Justifying unsupervised clustering using Random Forest?

I have been looking at ways to carry out unsupervised clustering of data with both numeric and nominal (but not ordinal) variables. I also suspect non-linearity in the data. A possible solution would ...