Partitioning data into subsets of objects according to their mutual "similarity," without using preexisting knowledge such as class labels. Clustered-standard-errors and/or cluster-samples should be tagged as such; do not use the "clustering" tag for them.

learn more… | top users | synonyms (1)

0
votes
0answers
13 views

How to interpret the numeric values for “height” using wards clustering method

I am a biology student investigating a new method of creating a dichotomous identification key. I have created a dendrogram using data I have collected from a survey on how people rate how similar ...
1
vote
1answer
28 views

Relationship between random variables that are parameterized

Suppose we have $n$ random variables $X_n$ - let's say these are measures of customer engagement - and we sample these $m$ times through a set of designed trials. The resulting $m$ data points define ...
1
vote
0answers
19 views

X-Means Likelihood for BIC

I have recently been trying to understand the X-means method for deciding on K, using BIC. However I have become stuck on one particular equation in the original paper. On the 4th page, when ...
0
votes
0answers
22 views

Iteratively estimating multiple gaussians to data

I have a 2-dimensional data $D$ of locations of objects per day ( each row is an object, and there are 3 features=columns: x&y coordinates and day) and I want to predict the areas of high ...
0
votes
2answers
25 views

Grouping customers together into like groups based on multiple variables without a categorical variable

I am looking for a little guidance as to the correct approach to this problem. We have a list of IDs and roughly 8 different numerical variables such as quantity and revenue. Each ID is unique to the ...
-1
votes
0answers
5 views

DBSCAN clustering method [closed]

I have a data set consisting of 75 observation. For each observation I have 152 variables on the likert scale. I want to use DBSCAN but I am unsure is this possible. If not want method would ye ...
-1
votes
1answer
14 views

Similarity measure for observations with many variable types

I'd like to do some exploratory data analysis using a 2d plot to demonstrate possible clustering of the subjects in a study. The subjects have many variables recorded, both quantitative and ...
0
votes
0answers
15 views

How to add cluster centers to the already transformed arrays with T-SNE Scikit Learn?

let's get this scikit original code, which is basically the one I'm using. My X is 2000x100 and in order to plot the clusters (plot on the right) I want to transform it with with the TSNE algorithm ...
1
vote
0answers
19 views

Interpreting silhouette coefficeint for clara function in R

I am trying to do clustering on a distance matrix which contains numeric data. But I am not sure how to decide upon the number of clusters or value k for clara function in R. But after running it with ...
-1
votes
0answers
10 views

how to give classes to hclust output at specific height [closed]

Am new to R , Using rect.hclust(fit2, h=10079,border="green") draws green rectangles around the matched points, how can I assign classes to these points and print ...
1
vote
1answer
41 views

What technique should be used to cluster urban areas

I am new to clustering algorithms. I want to cluster road junctions based on traffic, that is, intersections which have traffic between each other should be in one cluster. I also have a similarity ...
0
votes
1answer
45 views

Do I have too many variables and not enough data points for cluster analysis?

I have 75 observations and 152 variables. I want to perform cluster analysis. If I perform cluster analysis and this data will the results be meaningful? Do I need to reduce the number of variables ...
0
votes
0answers
35 views

Different Central Tendency Measures for Describing Groups or Individuals

Background: I have records with various metrics for many users. I want to develop a profile for each and also group similar users using clustering. Question: When developing a profile for each user, ...
3
votes
2answers
140 views

Which unsupervised classification method to use next if hierarchical clustering gave bad results?

Purposes I need to perform a classification of weather stations taking into account the characteristics of intra-annual variability of some two climate indicators. There are 613 sites with monthly ...
0
votes
1answer
21 views

Choosing principal component in R clusplot

I have created a cluster using LCA method. When I plot the cluster using clusplot, the two axes are always component 1 and component 2. In my case, the two components explain only 17.21% of the point ...
-1
votes
0answers
13 views

Clustering/classification before logistic regression

I have a little question. I am working with datasets in commercial bank, modeling scoring card using logistic regression. The GiINI is about 73-74 percents. I have an assumption that if I separate my ...
1
vote
0answers
55 views

How should one learn the centers for an hyper basis function network (HBF)?

I was reading the following paper on hyper basis function (HBF) (similar to radial basis function RBF network) and was trying to figure out how one learns the movable centers of the hyper basis ...
0
votes
0answers
15 views

What does “task-dependent clustering” mean?

I was reading the following paper on hyper basis function (HBF). Its about how one can use moving centers instead of data points as the centers of radial basis functions (RBFS). In the abstract they ...
0
votes
1answer
26 views

How to generate probability function for uncertain data based on euclidean distance?

I am calculating pairwise distances between some points. The obtained distances can either be accurate, over-estimated or under-estimated. The respective probability is 80%, 5% and 15%. And the error ...
-2
votes
0answers
18 views

Difference between clustering functions in R

I am trying to understand the difference between the varclus function and the hclustvar function for clustering in R. I understand that in the varclus function you can specify a similarity measure, ...
1
vote
1answer
56 views

Relating parameters to a measured variable

I have an ordinary differential equation based model for a system which depends on 16 parameters (all continuous and positive). I have 10000 random sets of parameters where each set has 12 elements. ...
1
vote
1answer
23 views

Clustering Analysis for large data in R

I am trying to perform a clustering analysis for a csv file with 50k+ rows, 10 columns. I tried k-mean, hierarchical and model based clustering methods. Only k-mean works because of the large data ...
3
votes
1answer
52 views

Understanding the use of logarithms in the TF-IDF logarithm

I was reading: https://en.wikipedia.org/wiki/Tf%E2%80%93idf#Definition But I cannot seem to understand exactly why the formula was constructed teh way it is. What I do Understand: iDF should at ...
0
votes
0answers
3 views

Profiling survey respondents with both categorical and ordinal variables

I have a mixture of categorical and ordinal variables from a survey that I am trying to use to create "profiles" or segments that differ from one another with respect to a dependent variable (the ...
0
votes
0answers
19 views

Clustering based on heterogeneous feature values

My data points are edges between genes, and I want to cluster them based on three feature values. Feature A is mutual information, feature B a ratio value ranging from 0 to 1, and feature C a p-value ...
0
votes
0answers
18 views

How to approach clustering when each object does not have the same number of qualities

I would like to apply a clustering algorithm to a set where each observation does not have the same number of "qualities". I have searched extensively online for this problem and were unable to find a ...
0
votes
1answer
12 views

Social Sciences: Screening cost-compliance survey

I have a survey in which 500 subjects were asked if they would take a screening test if the cost was free, \$1, \$10, \$50, and \$100. I have information on subjects' age, race, etc. I want to ...
1
vote
2answers
27 views

Silhouette clustering index in practice

I don't have much experience with data analysis algorithms (data mining, machine learning, if you like) and I'm interested if some could share their experience with practical usage of Silhouette in ...
-1
votes
0answers
15 views

Adjusted Rand Index (ARI) in Matlab

Hi I do not know how to use Adjusted Rand Index (ARI) index in Matlab, for example I have run my proposed clustering algorithm and I am readying a paper which has illustrated ARI index of its ...
0
votes
2answers
23 views

Clustering customers with transaction data

I'm rather new to machine learning but would like to use this to learn. I have access to a customer database with all transactions at the unit level. I'm pretty good with SQL so I can get the data in ...
0
votes
0answers
46 views

Normalization or standardization for distances in a Q-mode cluster and principal components analyses

I want to run a cluster analysis and a PCA between some sites to classify them in terms of their multivariate dissimilarity. This is a Q-mode analysis. I am working on a data matrix made of sites in ...
0
votes
1answer
7 views

Detecting outlying distributions of ratio data

I have a dataset consisting of hundreds of repeat observations on thousands of agents. Each observation is a ratio between two distance measures, A and B, where A is always larger than B. Thus, my ...
0
votes
0answers
33 views

Elbow method or the Silhouette to determine number of clusters

I would like to know what is the better way to determine the number of clusters - elbow method, or the silhouette? I've used elbow method, increasing number of clusters while the total distance ...
0
votes
1answer
59 views

Latent class analysis order classes

I am performing a latent class analysis with covariates. I want to calculate the predicted probabilities for the membership to different classes. However, if the order of the classes changes (as I ...
-1
votes
1answer
17 views

Clustering signals with multiple parameters

I have a measurement that contains a couple of signals, let's say Power, Speed and Pressure. I would like to cluster these measurements. At first I considered only one parameter at a time (for ...
1
vote
1answer
10 views

sklearn estimate_bandwidth in MeanShift algorithm with small dataset

How should I approach the estimate_bandwidth function with only very small datasets? My problem is that I am analyzing datasets that range from 500 entries to 2. ...
0
votes
1answer
32 views

Finding N-Most Similar Organizations to a Given Organization

I am looking to provide a model with one data point and have it return the observations most similar to that given data point. I am in the process of developing peer groups from a dataset of 240 ...
0
votes
0answers
26 views

How to design an objective function in Convolutional neural networks to classify unlabeled images?

Convolutional neural networks have been used in supervised learning such that it changes the weights $\Theta$ to minimize $(f(X;\Theta)-Y)^2$. However, for unlabeled data, how does one design a new ...
0
votes
0answers
33 views

Unsupervised Anomaly Detection with Mixed Numeric and Categorical Data

I am working on a data analysis project over the summer. The main goal is to use some access logging data in the hospital about user accessing patient information and try to detect abnormal accessing ...
2
votes
1answer
44 views

Anomaly detection based on clustering

I understand that there a lot of different methods for anomaly detection, based on classification, clustering, nearest neighbors, statistical, etc. I'm trying out clustering based approach. So, I'm ...
4
votes
2answers
72 views

Testing for cluster structure in one dimension

I have a set of points along an interval. What is the best significance test to measure clustering of the points in the interval (deviation from a uniform distribution)? I've added two examples below ...
1
vote
0answers
42 views

Checking the assumptions of K-means clustering

I want to do a k-means clustering on a dataset containing 22 numerical variables between 0 and 100 and 75 observations using R. I read this post How to understand the drawbacks of K-means on k-means ...
1
vote
3answers
55 views

Checking quality of clustering of labeled-class data

I'm performing clustering on a labeled dataset. I would like to check the quality of clustering. Is there a well accepted way of doing that? So basically I would like perform some classification-like ...
1
vote
0answers
18 views

Comparison of distributions

I measured the velocity of particles depending on some biophysical conditions (summarized data from two DoE plans) for about 100 samples. The goal was to identify the most important parameters ...
0
votes
0answers
13 views

Clustering Standardized Mortality Ratio

I am bit new to the whole clustering idea. I have a data set that gives information about the SMR in the different states of America from 1995-2000. Hence I want to apply clustering techniques ...
1
vote
2answers
25 views

What are some good (and fast) alternatives to dynamic time warping?

I am planning to cluster tens of thousands of time series of different lengths into two groups.
0
votes
1answer
32 views

Change in r squared due to clustering in multiple linear regression

Puny undergraduate stats student here. I am examining the effect of two regressors on a predictor. OLS on the raw data (approx 200k cases) yields next to no correlation in the following models: ...
0
votes
0answers
33 views

Power calculations for proportions, two-stage cluster

I am trying to do power calcs for a survey. It's not an RCT, so I have encountered a dearth of material on this. We are trying to estimate a proportion within a population, and have two stages of ...
0
votes
0answers
8 views

cross validation for non parametric clustering methods: dimensionality reduction possible?

I do have about 100 data points gathered during a DoE experiment. The response variable was the settling velocity distribution depending on 10 factors. I analysed the 10 % percentile of the ...
2
votes
0answers
32 views

Spatial clustering based on response

Statistics version: I have a few measurements of a function that takes three inputs and produces a few 2D fields of outputs: f(a,b,c;x,y), with f being a vector of several quantities. I would like to ...