Partitioning data into subsets of objects according to their mutual "similarity," without using preexisting knowledge such as class labels. Clustered-standard-errors and/or cluster-samples should be tagged as such; do not use the "clustering" tag for them.

learn more… | top users | synonyms (1)

1
vote
2answers
65 views

What algorithm does ward.D in hclust() implement if it is not Ward's criteria?

The one used by option "ward.D" (equivalent to the only Ward option "ward" in R versions <= 3.0.3) does not implement Ward's (1963) clustering criterion, whereas option "ward.D2" implements ...
1
vote
1answer
20 views

How can I make clusters with highly right skewed data?

My histogram of expected income is as below. As you can see, income is highly right skewed. I want to divide individuals with regard to income - for example into Low, Middle, and High, and then I ...
0
votes
0answers
3 views

Profile variable in collaborative filtering

I'm trying to create a recommendation system based on purchases. I did some tests and I found that for some groups of customers, the recommender works very well, but not for others. How can I ...
1
vote
0answers
12 views

Clustering spherical-shaped data

I have a data set that consists of census data (5 attributes). Performing PCA, I found that the original data looks like a big chunk (please look at the first picture), and therefore, I decided to use ...
1
vote
1answer
26 views

Finding optimal combination of parameters for clustering

I have a spreadsheet with one object per line. Each column contains values that are parameters of my objects (let's say length, width, height, weight, color). I can classify objects based on color and ...
1
vote
2answers
49 views

K means clustering inadequate in determining extreme regions in R

I want to identify the regions that are considerably higher than the highest cluster. (The obvious regions which should be identified as their own clusters, notably at the x coordinate ~10 e+07. How ...
0
votes
2answers
27 views

Suggestion for discovering inherent patterns in data

I have a a big data set of clients with all sorts of variables that describe their background, payment history, and more... I also have a subset of those client who all have portrayed similar ...
0
votes
1answer
44 views

identify different points [on hold]

I have a large scatterplot, with about 100,000 (x,y) points. The x coordinate is the set of numbers from (1 to ~100,000) - in other words, no 2 points have the same x-coordinate. The y is mostly ...
1
vote
3answers
20 views

Computing Image Similarity based on Color Distribution

Image Similarity based on Color Palette Distribution I am trying to compute similarity between two images based on their color palette distribution, let's say I have two sets of key value pairs as ...
1
vote
1answer
30 views

How to choose the right distance matrix for clustering?

I am attempting simple Ward type clustering. However, the R package is proving several choices to use for the distance matrix. I am wondering how I am supposed to determine the right distance matrix ...
0
votes
2answers
29 views

k-means vs k-median?

I know there is k-means clustering algorithm and k-median. One that uses the mean as the center of the cluster and the other uses the median. My question is: when/where to use which?
0
votes
0answers
3 views

Finding correlation of attributes based on known decisions

If there are two matrix of data, rows are all a person (under 50 users). In the first dataset, columns are attributes (over 500 columns) of a user with the rating 0 for does not exist, 1 for exist. ...
0
votes
1answer
25 views

How to test for correlation between frequency of an event and the stock market

I am currently running an event study, for which I need to find out if my events are clustered and/or if their frequency is tied to the stock market. Creating a scatter plot of the event dates and the ...
1
vote
0answers
19 views

clustering for histogram shapes

I am trying to get a start on a clustering problem. The sample data is trade volume at a particular price. Some notes about the data: number of bins vary from sample to sample (larger price range ...
4
votes
3answers
112 views

K-means cluster analysis with K=2 as a binary classifier

I used two variables, height and weight, and using K-means cluster analysis with $K=2$, two clusters were obtained. I used $K=2$, as the observations either belong to men or women. I then compared the ...
0
votes
1answer
41 views

Clustering high dimensional data (p > n) in R

I have a situation where we have a number of quantitative features / variables (p) than the number of samples (n). My objective is to classify these samples into groups (may be hierarchical). I can ...
2
votes
1answer
31 views

One-class Classification of multidimensional vectors

I have a m x k User-feature matrix (m >> k) obtained by factorizing an original User-websites matrix (m x n) that has #page views as entries. Additionally, there are users (say r) who have been ...
-1
votes
1answer
23 views

Metrics for cluster evaluation

I make a set of clusters using some clustering algorithm. Precision, Recall, F Measure, Fallout and RI of individual clusters are calculated for testing the performance. How do I calculate the average ...
1
vote
1answer
26 views

Creating a cluster analysis on multiple variables

I am working on creating a cluster analysis for some very basic data in r for Windows [Version 6.1.76]. The groups themselves are countries and then I have 2 column with continuous numerical ...
0
votes
1answer
53 views

hclust, R and Euclidean distances: weird stuff

I have a table of similarities expressed through cosines and am trying to do some cluster analysis in R, using hclust and ...
0
votes
0answers
21 views

Justifying unsupervised clustering using Random Forest?

I have been looking at ways to carry out unsupervised clustering of data with both numeric and nominal (but not ordinal) variables. I also suspect non-linearity in the data. A possible solution would ...
0
votes
0answers
7 views

Datasets for market segmentation

What are the gold standard datasets to test market segmentation algorithms with? I'd like to try a few algorithms on known datasets for comparison before I try my own dataset.
1
vote
1answer
35 views

Is there such thing as correlation trees? Clustering rows of X based on correlation between A and B

I have been searching for several days for a method that fits this description, though cannot find one. I'm pretty sure it must exist. The problem (short version): I'd like to run something like a ...
0
votes
0answers
40 views

Groups in linear regression with different intercepts. How do I find the differing variable?

This is more of a conceptual question. I have a coefficient estimate of .80 in a linear regression model with one IV and one dependent variable. However, plotting the data I see distinct groups, ...
0
votes
2answers
35 views

Finding independent “clusters” in a matrix

I've called my question "clustering" but I am not sure if that's the right term. Imagine my matrix looks like this: ...
0
votes
1answer
18 views

Searching for time series inside another time series

I have a time series "A" and another one "B". I would like to find occurrences of "B" inside "A". Typically, "A" is much bigger (magnitude: millions of points) than "B" (magnitude: hundreds of points) ...
0
votes
0answers
21 views

Using the coefficients of regression for giving weight to the data

I want to perform clustering on my data set. I used spectral clustering and obtained an acceptable result. In an effort to (maybe) improve the result, I thought of applying a linear regression on my ...
0
votes
1answer
38 views

Clustering of items based on their category belonging

I am trying to find a clustering algorithm, but I'm working with already classified items. Basically, items belongs to one or more category, which are already known. Categories are absolutely not ...
1
vote
1answer
34 views

Time Series Data Mining Library?

Can anyone recommend a library for time series data mining tasks other than predictive modeling and statistical analysis? There seem to be a number for these purposes (e.g., Gretl), but nothing for ...
1
vote
1answer
31 views

A clustering and classification question

I'm trying to classify my set of data into two classes (introvert / extrovert). I was thinking of using a decision tree at first, but I don't have any potential known results in order to create my ...
1
vote
1answer
32 views

Clustering a completely interconnected graph with weighted edges

I was wondering if Markov Clustering is what I really am looking for or not. Basically I have a N node graph in which every node is directly connected with one another. However, all the edges are ...
1
vote
1answer
35 views

cluster analysis, Ward: how to evaluate number of clusters and their quality?

I have a table of similarities (cosines) and I clustered it with the Ward method. Great outcomes, a wonderful dendogram, but then I tried to evaluate the quality of this cluster solution and I got ...
1
vote
1answer
100 views

Pull out most important variables from PCA

I would like to get the most important variables from a PCA result. I see two clusters in the plot. I now that is possible that there is no only one variable causing this, so maybe I would have to get ...
0
votes
1answer
29 views

Classifying a set of photos to places

I want to cluster photos and map them to places. As input I have Photos with locations (lat, long) Places - some as (imprecise) bounding boxes, some just as points, maybe others as bounding ...
1
vote
2answers
44 views

clustering accuracy

I have a general doubt regarding clustering. I have a data set of size 1196*18675. where 1196 is the no of documents. I am trying to cluster the data with k=7 using k-means. Each time the clustered ...
1
vote
0answers
21 views

Setting up feature vectors

I am working on a classification project and I want to use SVM's and/or Clustering Algs. What I am having trouble with is deciding how to set up my feature vectors. I have already decided what my ...
2
votes
0answers
28 views

Hierarchical Tobit Model

I'm studying the effect of various criminal case and court district characteristics on sentence lengths. I was planning on running a hierarchical linear model (HLM) of individual defendants/cases ...
0
votes
1answer
35 views

using cluster information in multiple imputation

i need to impute a dataset all categorical variables before doing analysis. I can just simply impute with mode of all data or a variable. I belief that better option will be to classify the subjects ...
0
votes
1answer
22 views

What method to use for cluster identification ?

This question is from a confused novice. I have a data set with where each point is located in a 2-D space defined by two objectives (say, X and Y). I wish to identify a set of points from this space ...
0
votes
0answers
44 views

(Spatial) distance between cluster means

I'd like to cluster points based on a distance criteria. As I want to cluster spatial points I am using euclidean distance and a hierachical cluster approach. In a final step I'd like to cut the ...
0
votes
0answers
16 views

Cluster analysis of open-question responses

I am currently analysing a 1100-observation dataset of open-question responses. I was wondering whether I could really do a segmentation based on these responses. What I've done is so far is ...
1
vote
1answer
31 views

Is it posible to perform the inverse of multidimensional scaling analysis

We have lot of 3D data and we reduced it to 2D for performing fuzzy clustering and obtaining prototypes. We used some matlab functions that were very well documented. Now we would like to see to which ...
0
votes
2answers
92 views

Excel: which products are most frequently ordered together? (clustering question)

I'd like to recruit your help in coming up with an Excel-based method to analyse a set of raw ordering data where each item is on its own row. So, in the data below, order 111 contains two part ...
1
vote
0answers
29 views

Reducing high dimensionality as well as feature selection on multivariate time series

Lately I've been reading a lot about time series clustering as I want to search for similar patterns in my own data set. Even though I feel like I understand the basic concepts of this task I still ...
0
votes
0answers
6 views

Turning MiniBatchKMeans into Fuzzy MiniBatchKMeans

I'm using Scikit-Learn, which has an implementation of MiniBatchKMeans. I'm very inexperienced with ML, so I'm wondering how (if ...
2
votes
4answers
236 views

Clustering binary categorical data

I have some data where I have certain classes (c1, c2, c3, c4 ...) and the data comprises of binary vectors where 1 and 0 denote that an entry belongs to a class or not. The number of classes will be ...
0
votes
0answers
24 views

Spectral clustering using RBF Kernel function in R

I have extracted user-features and item features in my recommender system using a modified SVD approach built on ALSE (loosely based on Yehuda Koren's paper). I now want to cluster items not directly ...
2
votes
1answer
39 views

Which clustering technique to use for a temporal dataset?

I have seen a similar question but thought I'd ask my own to hopefully garner some usefull feedback. Basically, I have a large temporal dataset, consisting of domestic smart energy meter use ...
1
vote
1answer
17 views

Cluster Analysis Sample Size for Diss Proposal

My psychology dissertation will be a cluster analysis with one grouping variable. How do I know how many participants I need? I imagine there should not be more than 5 clusters. 79 items make up 9 ...
1
vote
0answers
19 views

Suitable plot for 5 dimensional feature vectors?

I have a list of personality scores obtained from 100 people, based on the Big-Five personality test. Each person has one score for each of the five assessed traits. I put these scores into a 5 ...