Skip to main content

Questions tagged [semi-supervised-learning]

Semi-supervised learning refers to machine learning tasks using a mix of labeled and unlabeled data. The goal is to learn a mapping from inputs to outputs, or to obtain outputs for particular unlabeled inputs. The unlabeled data is used to learn about underlying structure of the inputs, which can improve learning about the relationship between inputs and outputs. Semi-supervised learning involves elements of both supervised and unsupervised learning.

Filter by
Sorted by
Tagged with
0 votes
0 answers
12 views

ML Clustering with an added condition

Problem: I want to create distance-based clusters of customers where each cluster, in sum, yields the same revenue potential. Explanation: I'm looking at thousands of customers spread throughout a ...
Tommy Lee's user avatar
1 vote
0 answers
63 views

Test set creation for a rare category classifier

I want to make a classifier for a very rare category. The base rate in a random sample is about 0.01%, estimated from finding about 10 positive examples using a zero-shot classifier on 100,000 ...
Quarticle's user avatar
2 votes
0 answers
18 views

Looking for a way to train a model to learn optimal parameters/hyperparameters of clustering

I have 5000 docs, each is a review. For each review, I'm plotting the sentences in a semantic dimension. Now, I'm applying clustering to these points for each review. The success of my model depends ...
Prithvi's user avatar
  • 21
0 votes
0 answers
21 views

Best way to classify text based on a set of seed/keywords

This question was asked six years ago but figured it was worth an update. I'm attempting to filter news data based on a set of keywords. I think the ideal process for this would be some form of: ...
creekjumper's user avatar
1 vote
0 answers
34 views

Linear Discriminant Analysis with unlabeled data

In section 4.4.5 "Logistic regression or LDA?" of Elements of Statistical Learning by Friedman, Tibshirani and Hastie, it is claimed the following: From the mixture formulation [that is, ...
Sergio's user avatar
  • 336
0 votes
1 answer
57 views

What is the value of semi-supervised learning?

I've read that semi-supervised learning can be useful when you only have a small amount of labeled data. However, I'm struggling to understand the practical implications and benefits of this approach, ...
JAdel's user avatar
  • 125
7 votes
1 answer
42 views

Semi-supervised learning with two models

Let's say you want to train a model so that you can make some predictions when you get some future data. You find some training data. Some of the training records have labels but other records do not. ...
Ryan Zotti's user avatar
  • 6,717
1 vote
0 answers
39 views

Training with unlabeled data and the probability of correct classification

Suppose we have two binary classifiers based on deep learning. The second classifier is able to tell me with a probability not very high but better than a random guess (let's say 70%), if the ...
Daniel Lerch's user avatar
1 vote
1 answer
631 views

Do you use the PC1, PC2, PC3 or do you use PCA for feature selection in supervised learning? [closed]

My goal is to understand what is PCA for in supervised learning. Do we use the PC1, PC2, PC3 to the supervised learning? Do we use the generated labels to the supervised learning? If we use the PC1, ...
Jason Rich Darmawan's user avatar
2 votes
1 answer
341 views

Approaches for semi-supervised fine-tuning after self-supervised pre-training

My understanding is that self-supervised learning approaches approximately work like the following (I have Wav2Vec 2 in my mind here, used in speech recognition, but NLP transformer models are similar)...
phipsgabler's user avatar
1 vote
1 answer
90 views

For semi-supervised learning, is more pseudolabels always better than less pseudolabels?

Let's say I have a labeled dataset $L$ and unlabeled dataset $U$, where $U \gg L$. Suppose I focus on a subset of $U$ called $u$ and generate a subset of $u$ I'll call $u_L$ that consists of ...
Sanger Steel's user avatar
2 votes
0 answers
187 views

Why use IsolationForest over other supervised methods for semi supervised learning?

I have a dataset with labels that I'm using to explore unsupervised learning (IsolationForest) with. IsolationForest has a few hyperparameters, and some can be heuristically determined like maybe you ...
Sky's user avatar
  • 21
1 vote
0 answers
43 views

Role of auxiliary objective in semi-supervised VAEs?

In these two papers, mainly: Klys, Jack, Jake Snell, and Richard Zemel. "Learning latent subspaces in variational autoencoders." Advances in neural information processing systems 31 (2018). ...
MerelyLearning's user avatar
5 votes
1 answer
375 views

Is the likelihood for Gaussian mixture models still multimodal when Y is partially observed?

In discussing Gaussian mixture models (GMMs), https://normaldeviate.wordpress.com/2012/08/04/mixture-models-the-twilight-zone-of-statistics/ highlights the issue of Multimodality of the Likelihood. ...
Adrian's user avatar
  • 4,374
2 votes
0 answers
918 views

Weak supervision vs semi-supervised learning

What exactly is the difference between these two and when should they be used? Context : I have a large set of unlabelled data. I can get a number of weak labels / labeling functions for all of the ...
łówkèÿ's user avatar
0 votes
0 answers
37 views

What kind of semi-supervised learning method should be used for a low quality data set?

Consider a binary classification problem, there are $1000$ samples in the data set, of which $500$ positive and negative samples each. Positive samples have the label $1$ and negative samples have the ...
3029 serity's user avatar
1 vote
0 answers
21 views

About the mean-teacher algorithm, in the end we should use the student or the teacher model?

It may sound silly, but I didn't find an official approach about which final model I should choose when the mean-teacher training ends, even on the original paper. I know both will have very similar ...
Rafael Toledo's user avatar
0 votes
1 answer
1k views

Semi-supervised learning: Classification vs Clustering

In the context of a semi-supervised learning problem, what's the difference between using a classification algorithm vs a clustering algorithm? Traditionally classification is supervised and ...
luke's user avatar
  • 101
1 vote
0 answers
451 views

What is the best approach: Labeled training data and unlabeled test data [closed]

I'm new into the data science world and I am working on improving my knowledge so here is my problem: I want to build a binary classifier with the following constraints: I have 2 files training.csv ...
datanoob's user avatar
0 votes
1 answer
113 views

Computing a prior from two components in Naive Bayes

Given a model parameter $\theta$ that is composed of two distributions in a Naive Bayes classifier, how is $P(\theta)$ typically computed in practice? More specifically, from the article of Nigam et ...
user avatar
1 vote
0 answers
87 views

Improving synthetic oversampling with unlabelled data

I am working on a classification problem with a small amount of labelled data (~200 instances) and a larger sample of unlabelled data (~500 instances). To increase the size of the training data I am ...
A. Bollans's user avatar
1 vote
1 answer
686 views

Binary Classification with a third 'uncertain' class label

Consider the task of classifying an image into two classes: Image shows a cat; Image shows no cat. A data set is provided for training/testing a binary classifier. However, three labels are provided ...
Háski's user avatar
  • 11
9 votes
1 answer
216 views

Semi-supervised classification objective from Kingma et al

In this 2014 paper, Kingma et al. develop different methods to do semi-supervised learning with VAEs. In one of their proposed solutions ("M2"), they approach this problem by incorporating ...
Ruben van Bergen's user avatar
2 votes
1 answer
112 views

Can I construct a target variable out of correlates and proxies when my training data does not have the actual target variable that I need?

I want to classify customers who at risk to churn (unsubscribe). The typical path would be to have a training set of historical data that includes observations of customers who churned so that we have ...
AJV's user avatar
  • 687
1 vote
0 answers
522 views

What are the SOTA Visual Representation Learning architectures for binary images?

I want to learn the visual representation of binary images such as: This may later be used for the shape classification problem. I have read 2 state-of-the-art visual representation learning ...
Eager-to-learn's user avatar
1 vote
0 answers
35 views

Lots of unlabeled data and small set of labelled data of one class [closed]

Does anyone have suggestions for specific algorithm or implementation for labeled data of only one class and unlabeled data that can be from either classes? And I'm unsure what is the proportion of ...
Deli's user avatar
  • 11
1 vote
1 answer
75 views

Is it possible to alter binary classification models to do postive-unlabeled learning in Pyspark?

I'm learning how to use pyspark, and I'm wondering if it has any ways to implement positive-unlabeled learning? From searching this question I haven't been able to find any examples specific in spark ...
DN1's user avatar
  • 111
1 vote
0 answers
91 views

Semi-Supervised Hierarchical Topic Model

Problem statement: I'm looking to label some data with topics. These topics have a hierarchical structure (3 layers deep at maximum, but I have leaf nodes 2 layers down as well) that I have been given....
Evan Mata's user avatar
1 vote
0 answers
22 views

Problem with a dataset not being properly labelled

I have a labelled dataset but these classes are not perfect. Some classes should be combined into one, whilst others have too few data-points for training. My main concern is the former not the latter....
Alvaro dM's user avatar
0 votes
0 answers
40 views

semi-supervised classification with a single label

I have a dataset of 1800 entries with about 40 features (some binary, some numerical). Of the 1800, 12 are known to be good for my goal; and the rest are unknown. Of the 1800 only 25-30 of the entries ...
L A's user avatar
  • 1
1 vote
1 answer
126 views

Q-function in Q-Learning

I ran into solved old-exam question as follows: My notes tell me that option b is correct but I think option d is correct. is there any idea why (b) is correct?
user avatar
1 vote
2 answers
212 views

Semi Supervised learning vs Supervised

I am trying to understand the mathematical properties of supervised learning and semi-supervised learning. Let us consider the case for the mean $\mu$. Then the supervised learning estimator can just ...
user593295's user avatar
2 votes
1 answer
318 views

What is noise-tolerant learning?

I was reading this Development and validation of phenotype classifiers across multiple sites in the observational health data sciences and informatics network and came across the below paragraph. Can ...
The Great's user avatar
  • 3,302
2 votes
1 answer
486 views

Evaluating multiclass imbalanced problem per class

For a multiclass imbalanced problem, accuracy is not a good metric to evaluate model performance. Equally, accuracy is a global ...
arilwan's user avatar
  • 273
1 vote
1 answer
1k views

Training samples with no labels: To include or not to include?

I am working on a multi-label classification problem. Each sample is capable of taking more than a single label. Sometimes samples don't have any labels associated with them. My dataset has 50% ...
Aishwarya A R's user avatar
0 votes
0 answers
20 views

Latest research and explanation on how semi-supervised learning is performing better than supervised?

So in AAAI 2020 also semi-supervised learning is given the push. There are some intuitive reasoning provided by people but since the research is so fast, I wanted to know actually what is the latest ...
Aaryan BHAGAT's user avatar
3 votes
0 answers
441 views

Evaluating Semi-supervised Learning

Is there a standard procedure to evaluate a semi-supervised learning algorithm? Say if I have a set of labelled data (500 spam & 500 non-spam), and a set of 50,000 unlabelled data. Theoretically, ...
Stuart Peterson's user avatar
2 votes
1 answer
55 views

Active learning with a unlabelled pool - standard references & model-based labelling of the pool?

I'm looking into active learning for a multi-class classification problem, where there is a large pool of unlabelled data. I start out with a small set of labelled data and can labelled some more of ...
Björn's user avatar
  • 33.5k
29 votes
2 answers
15k views

What's the intuition behind contrastive learning or approach?

Maybe a noobs query, but recently I have seen a surge of papers w.r.t contrastive learning (a subset of semi-supervised learning). Some of the prominent and recent research papers which I read, which ...
CATALUNA84's user avatar
1 vote
1 answer
260 views

Semi supervised learning with partially unobservable labels

As I understood the concept of semi-supervised learning is to train a classifier on the minimal available subset of correctly labeled data in order to predict the labels of a greater previously ...
Marco Repetto's user avatar
2 votes
3 answers
3k views

Can we say that RNN for time series is an example of semi-supervised learning?

I am learning neural nets, esp. focusing on RNN for my research problem. This question has nothing exactly to do with my research. With my understanding of RNN, I can think of it as an example of ...
SJa's user avatar
  • 544
1 vote
1 answer
338 views

Does it make sense to use feature selection methods to reduce dimensionality for unsupervised clustering?

If I have a dataset that is labeled with positive and negative examples, and I'd like to cluster (i.e. unsupervised) only the positive examples, does it make sense to reduce dimensionality using ...
tborenst's user avatar
  • 111
1 vote
1 answer
67 views

What is it called to cluster some inputs, then classify other inputs into those clusters?

I am learning about the problem of whole-book recognition, which is tangential to optical character recognition. Some of the strategies used to identify printed characters rely on first unsupervised ...
Aaron Brick's user avatar
2 votes
1 answer
95 views

How do you train a model on a dataset that's unlabeled but we know the percentage of every class?

Say we have a data set that's pictures of apples and oranges, but we don't know which is which. However the data is organized in such a way, that for some groups of images we know how many of them are ...
HL.'s user avatar
  • 123
1 vote
0 answers
37 views

Need some help understanding the factorised posterior in semi-supervised generative modelling

I am having a bit of trouble with the derivation in Kingma's semi-supervised generative modelling paper for the M2-model. The M2 model assumes a probabilistic model where the data $x$ is generated by ...
user2037067's user avatar
1 vote
0 answers
47 views

Filling in Missing Data for Biological Experiment

I am trying to implement a semi-supervised learning model with biological data. In my case, I'm using features from DNA. I have a number of experiments each with many observations. Each observation ...
Sameer L's user avatar
1 vote
0 answers
126 views

In semi-supervies learning, is "low density separation" the same thing as "pseudo-labelling"?

I'm looking into the different methods of semi-supervised learning. In the wikipedia page, one of the methods described is called "low-density separation", where we attempt to minimize this loss ...
Itamar Mushkin's user avatar
1 vote
2 answers
276 views

Semi-supervised objective function VAE

In Kingma's paper on Semi-supervised learning https://arxiv.org/pdf/1406.5298.pdf, we are shown equations for the ELBO for the semisupervised case, however I am having a hard trying to derive the math ...
Rebelzane's user avatar
1 vote
1 answer
208 views

Weak Supervision - training generative model without knowing the true label

Recently I've been reading about weak supervision. I understand most of the concept details, there's one thing that is not clear to me though. In the generative model part (creating generative model ...
Matek's user avatar
  • 991
2 votes
1 answer
674 views

Is there something more effective than ladder networks for semi-supervised learning?

The paper Semi-Supervised Learning with Ladder Networks by Rasmus is famous and interesting but a bit old now. Did researchers find any better option for semi-supervised learning ? For example, what ...
Hugo Laurençon's user avatar