The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [unsupervised-learning]

Finding hidden (statistical) structure in unlabelled data, including clustering and feature extraction for dimensionality reduction.

Filter by
Sorted by
Tagged with
1
vote
1answer
43 views

Linking generative, discriminative models to supervised and unsupervised learning

Definitions that I am considering: A generative model learns p(x,y) whereas a discriminative model learns p(y|x=x). I would like to verify if my understanding is correct by sharing the following ...
2
votes
1answer
63 views

Scaling data with different importance

I have 9 attributes: x1,x2,x3,x4,...,x9 and I know that the attributes x9 must have the same value in a cluster and the attribute X1 have more importance than others (x2,...,x8) I'm using Euclidean ...
1
vote
2answers
41 views

Define attribute importance in unsupervised learning [closed]

I'm using 'NbClust' package to help me to get the "optimal number of clusters" and I noticed in my dataset I have attributes with different importance. I have 5 attributes: x1,x2,x3,x4,x5 and I know ...
0
votes
0answers
34 views

Truncate a Hierarchical Clustering tree in order to get the cophenetic coefficient

I've gone ahead and clustered a dataset using a Euclidian Hierarchical Clustering algorithm: ...
1
vote
2answers
364 views

In k-means clustering, why sum of squared errors (SSE) always decrease per iteration?

In k-means clustering, why sum of squared errors (SSE) always decrease per iteration? How can prove it by mathematical derivation of formulas? k : number of clusters m : number of examples $c_h$ : ...
0
votes
1answer
100 views

Issue in evaluating the performance of my “clustering algorithm” using NMI, ARI when the “ground truth” is available? [duplicate]

(**Edited the question after the initial comments) Suppose, Ground_truth_data = [1, 1, 1, 1, 1, 1, 1]; Clustering_result = [1, 1, 1, 1, 1, 1, 2]; Here, as you can see, there are "7" instances of ...
0
votes
1answer
251 views

How to tune the hyperparameters for oneclass SVM while doing unsupervised learning?

For my task, I am doing unsupervised learning and I am trying to find the best possible value of the parameters gamma and nu in ...
0
votes
2answers
32 views

How to include percentage variables in PCA + K-means when some values are undefined because the denominator is 0?

I'm trying to do customer segmentation by using PCA to reduce dimensionality and then feeding the resulting principal components into a K-means algo to get at the final segments. Some of my variables ...
9
votes
1answer
348 views

t-SNE with mixed continuous and binary variables

I am currently investigating the visualisation of high-dimensional data using t-SNE. I have some data with mixed binary and continuous variables and the data appears to cluster the binary data much ...
2
votes
0answers
38 views

Differentiate Semi-supervised vs Transductive Learning?

Can someone explain the difference between transductive learning and semi-supervised learning? Or is semi-supervised learning a type of transductive learning? Transductive learning is when we do not ...
0
votes
1answer
119 views

Finding Optimal Number of Clusters in Expectation Maximization Algorithm

I know that there are several methods (Elbow method, silhouette analysis etc) which can help me to find the best number of clusters. My questions are: What are the best methods to use in ...
0
votes
1answer
141 views

Unsupervised VAE model? [closed]

I would like to use VAE model in unsupervised learning to generate new feature. Most of the examples are supervised and semi-supervised learning. Where can I find for unsupervised learning or can it ...
0
votes
1answer
162 views

On feature scaling and weighting for clustering

The issue of feature scaling and weighting for cluster formation has been widely discussed in several books and papers as well as several questions (e.g. here ). To my understanting, variable range is ...
2
votes
1answer
75 views

Unsupervised clustering of sequence of events to subsequences

I have a big dataset of M sequences of [1 - N] events, where each event has multiple properties (start date, end date, location, ...
0
votes
1answer
27 views

Unsupervised methods for Detecting Spam

What are some common unsupervised methods used to detect whether something is spam or not? For example, we may be given a large corpus of emails and need to determine whether any one of them is spam. ...
4
votes
1answer
427 views

How can t-SNE or UMAP embed new (test) data, given that they are nonparametric?

I have started using the UMAP method for dimension reduction which is a similar method to t-SNE, Diffusion Maps, Laplacian Eigenmaps, etc. The named dimension reduction methods have in common that ...
5
votes
2answers
58 views

Why are Generative Adversarial Networks classed as unsupervised

The title of the question is basically all I'm asking, but I should explain why GANs don't seem to be unsupervised to me! Here's my understanding of unsupervised learning: Unsupervised learning is ...
1
vote
1answer
201 views

What is the assumption on the distribution of data in gaussian mixture models?

I am reading about Gaussian mixture models from this slide https://www.ics.uci.edu/~smyth/courses/cs274/notes/EMnotes.pdf However, I am super confused at the very first line. It says: We ...
0
votes
1answer
35 views

When is it okay to label data yourself? (And semi-supervised learning)

i'm pretty new to machine learning so i think this might be a realy basic question. Let's imagine the following scenario: I want to classify projects as either active or inactive. Projects can be ...
7
votes
2answers
984 views

Why use a Gaussian mixture model?

I am learning about Gaussian mixture models (GMM) but I am confused as to why anyone should ever use this algorithm. How is this algorithm better than other standard clustering algorithm such as $K$-...
0
votes
0answers
76 views

Shared latent spaces

I have two interrelated response variables $A$ and $B$ over each observation $i$ in my data. I am trying to create an unsupervised model where observations could be explained by means of latent spaces(...
0
votes
0answers
104 views

Training a neural net as a classifier when there are no labels

I have an ML problem where I have a large data set and in this data set there are N categories. We have no labels. I want to be able to take this data set and use it to train a neural network to ...
0
votes
1answer
48 views

clustering location based on sorted time

I clustered my dataset based on location using DBSCAN(haversine). Everything is OK until this. However, I'd like to use the time series while I'm clustering my dataset. For example. You were at home ...
1
vote
0answers
11 views

Find a set of k non-negative vectors that explain most of the variance of the dataset?

I have a set of securities and I am looking for long-only portfolios that explain most of the variance of the set of securities. If it weren't for the long-only requirement, I could have used ...
-1
votes
1answer
47 views

How to predict without labeled data

I have a data set for patients visiting emergency departments containing following features: The output variable in this data set is "disposition" - whether a patient becomes admitted or discharged. ...
2
votes
0answers
76 views

Is there a well established algorithm to match two documents on a semantic level?

I have a set of documents from a wide variety of topics and I would like to retrieve the ones that are more similar to a new document provided. A search based on common words is not good enough, so ...
0
votes
2answers
37 views

Meaning of Probability Distributions in RBMs

I'm new to machine learning, and am trying to understand some of the basics of Restricted Boltzmann Machines. Unfortunately, I don't have a background in statistics yet beyond a basic understanding, ...
2
votes
1answer
59 views

Distance metric with characteristics of cosine and Manhattan

I'm working on a project where I want to find similarities between groups of events. So far I have expressed groups of events as vectors of event counts and computing similarities between them. I'm ...
2
votes
1answer
404 views

Image feature extraction using an Autoencoder combined with PCA

Background: I have fairly large dataset of biomedical images (around 10,000 images) of 1920x1920 pixels (after cropping parts of black borders out). My task is to extract the 200 most important ...
1
vote
1answer
208 views

Finding similar text - algorithms and evaluation

I've been asked to create a program that will rank similar texts to an input text given a collection of text. So far I've been using a tdidf representation and cosine similarity with a lot of regex-...
1
vote
0answers
70 views

How do unsupervised credit scoring models that don't consider historical financial data work?

There seems to be a number of startups (Zest Finance, Credolab etc.) that provide credit scoring schemes that rely exclusively on alternative data without considering users historical financial data ...
2
votes
1answer
68 views

Clustering circles with different radii with Gaussian Mixture Models

I am interested in clustering $N$ circles in the plane with varying radii using a Gaussian mixture model. The radius of each circle is an integer number $R_i\in\mathbb{N}$ determined from observation. ...
1
vote
0answers
11 views

How do I calculate ensemble-averaged PCA scores?

For context, please see https://arxiv.org/pdf/1808.00084.pdf (page 6) I am trying to replicate the results of the above link, which uses dimensionality reduction to observe a phase transition in an ...
0
votes
1answer
23 views

Searching for the correct approach

I'm writing my Bachelor Thesis within the field of neural networks and I need some preparation of the data I'm using. Do you have an idea how I am able to identify the four levels in this graph via ...
2
votes
2answers
410 views

Unsupervised Learning: Train Test division

I have one conceptual question. In Unsupervised Learning, when I have no labels. The anomaly detection model (Isolation forests, Autoencoders, Distance-based methods etc.), it should fit on a ...
2
votes
1answer
708 views

When does my autoencoder start to overfit?

I am working on anomaly detection using an autoencoder neural network with $1$ hidden layer. This is an unsupervised setting, as I do not have previous examples of anomalies. The input data has ...
2
votes
0answers
36 views

Understanding short animation about Dirichlet Process Mixture Model

On the wikipedia page of Dirichlet Process, there is the following video. I don't get the point of the video. My first impression was that the video was showing the fitting of one-dimensional data ...
3
votes
2answers
57 views

Confusion in modelling finite mixture model

From the book "Machine Learning a probabilistic Perspective", I'm reading about finite/infinite mixture models. Particularly at paragraph 25.2.1 it's stated: The usual representation (of a finite ...
2
votes
1answer
127 views

Custom Loss Function - Inducing sparsity

From the comments, I realized that my question wasn't clear enough, so I'll start with a short background. I am trying to construct an attention model that performs classification based on just a ...
2
votes
0answers
45 views

Performing clustering without a distance matrix

I have n vectors and a matrix of similarity scores between them (e.g. vector 1 score of similarity with vector 4 is 1.3, and with vector 7 is 2.3). This matrix is ...
2
votes
0answers
323 views

Clustering as a method to find and label classes for supervised learning

I'm working on a text classification project. We have around 300k documents (small, 1~2 phrases) and we don't know the set of labels or how many labels there are. The recommended approach to me was ...
1
vote
1answer
140 views

Latent variable in Gaussian Mixture Model

Whenever I look up material pertaining to Gaussian Mixture Models, it always mentions latent variable $z$, where $z \in \{1, ..., K\}$ and is one-hot encoded. I completely understand the objective of ...
0
votes
3answers
308 views

Why are decision trees considered supervised learning?

It seems to work similar to clustering algorithms, where data does not have to be labeled, and the algorithm creates it's own labels/groups based on feature similarities...
2
votes
0answers
87 views

clustering objects in point cloud

I am currently working on point cloud data analysis, trying to label objects which are not ground, vegetation, etc. So far I tried many clustering algorithms, with moderate success. In my best model ...
0
votes
0answers
25 views

DBSCAN loops one or several times a data point?

I am trying to construct a model data to facilitate the clustering algortihms execution in terms of searching for data point in the dataset. This model is a set of connections between points such that ...
3
votes
2answers
115 views

External validation of clustering requires labels, but why cluster at all if you have labels?

There are two types of validation in clustering, using: Internal indexes: Used to measure the goodness of a clustering structure without respect to external information (e.g., sum of squared errors)...
1
vote
1answer
48 views

How can I tell if an Autoencoder is encoding my data properly?

Autoencoders can be classified as a method of unsupervised learning, and unsupervised learning often comes with a problem where it's hard to tell if the model is working properly. However, some ...
1
vote
1answer
207 views

Is clustering subsequences of time-series still meaningless with unsupervised learning?

In the paper "Clustering of Time Series Subsequences Is Meaningless" Keoh et al. claim that breaking a time-series into chunks (sometimes called lags) of fixed-size using the rolling window method ...
1
vote
1answer
185 views

Clustering data that includes a categorical variable with many different levels

I'm looking to cluster data on apartments. I have the following variables for each apartment: Latitude Longitude Price Number of bathrooms Number of bedrooms Amenities (washer, gym, etc.) The ...
1
vote
0answers
29 views

Performance of Hierarchical Temporal Memory on unsupervised online anomaly detection problems

I'm looking for an algorithm to detect anomalies in streaming data (server metrics). The detection needs to be near-real time and unsupervised (labeled data will never be available, unfortunately, and ...