Questions tagged [active-learning]

Active learning is a setting where an automated learning system can request labels from an external source, perhaps a human user or a real-world experiment. It is used to try to learn good models while minimizing the number of interventions required.

7
votes
3answers
133 views

Using ML to assist human labelling in dataset with highly unbalanced classes

Are there scientific issues with using ML to assist human annotation? I've got a 3 class unlabelled dataset where only 1 in 500 elements belong to the 2 classes of interest. The labels arn't ...
1
vote
2answers
510 views

Strategies for incorporating feedback for a ML algorithm

I am developing a text classification problem, in which at some time points, say at the end of each week, I receive a batch of feedback from users about correctly and wrongly classified inputs. I am ...
1
vote
1answer
307 views

Active Learning with Human-in-the-Loop

I did a lot of research and can't find a satisfactory answer. I have just a quick question about Active Learning and would be pleased if you could answer it. I'm still wondering if active learning ...
2
votes
0answers
56 views

Active learning system confusion matrix

A colleague of mine has been developing a machine learning system with an active learning component. I was having trouble reproducing the metrics he's been reporting, until I found out that he's ...
1
vote
0answers
15 views

What is the convergence criteria of a semi-supervised learning algorithm

I would like to know about when to stop doing semi supervision? for example, I learn a classifier from a small dataset, and then I use it to label a pool of unlabelled dataset. How long should this ...
1
vote
0answers
44 views

Active learning for object detection- Batch Selection

I have a small dataset of about 220 images for three classes. I am using YOLO (you only look once) network for an object detection. I am trying to use Active learning in order to reduce the number of ...
1
vote
0answers
31 views

What description fits this this learning scenario, is this a form of active learning?

A system is involved in dialog with a human partner. The system has a model of a problem domain and knows mappings between words an concepts. The human has its own model of the problem domain and ...
1
vote
0answers
59 views

Is a test set sampled after training examples have been removed by an active learning algorithm valid?

In this case desire is to optionally label a final test set after training. The training is to be done using an active learning approach which can be biased towards different characteristics (...
0
votes
0answers
24 views

Using decision tree + active learning for regression?

Existing literatures that concerns using decision tree to do regression is more limited compared to its classification companion. The same also holds for research regarding active learning. I am just ...
0
votes
0answers
21 views

Using active learning to polish the accuracy after learning from a dataset

I am trying to create a prediction model which would return a numerical score upon receiving a set of representative numbers. The purpose was to replicate human quality assessment procedure upon ...