Questions tagged [active-learning]

Active learning is a setting where an automated learning system can request labels from an external source, perhaps a human user or a real-world experiment. It is used to try to learn good models while minimizing the number of interventions required.

12 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
2
votes
0answers
70 views

Active learning system confusion matrix

A colleague of mine has been developing a machine learning system with an active learning component. I was having trouble reproducing the metrics he's been reporting, until I found out that he's ...
1
vote
0answers
17 views

What is the convergence criteria of a semi-supervised learning algorithm

I would like to know about when to stop doing semi supervision? for example, I learn a classifier from a small dataset, and then I use it to label a pool of unlabelled dataset. How long should this ...
1
vote
0answers
103 views

Active learning for object detection- Batch Selection

I have a small dataset of about 220 images for three classes. I am using YOLO (you only look once) network for an object detection. I am trying to use Active learning in order to reduce the number of ...
1
vote
1answer
487 views

Active Learning with Human-in-the-Loop

I did a lot of research and can't find a satisfactory answer. I have just a quick question about Active Learning and would be pleased if you could answer it. I'm still wondering if active learning ...
1
vote
0answers
33 views

What description fits this this learning scenario, is this a form of active learning?

A system is involved in dialog with a human partner. The system has a model of a problem domain and knows mappings between words an concepts. The human has its own model of the problem domain and ...
1
vote
0answers
80 views

Is a test set sampled after training examples have been removed by an active learning algorithm valid?

In this case desire is to optionally label a final test set after training. The training is to be done using an active learning approach which can be biased towards different characteristics (...
0
votes
0answers
8 views

metric for unbalanced subsets in an active learning scenario

I am looking for a metric which measure "How unbalanced" a data subset is BUT since I will use it in an active learning scenario which means that my subset might not only unbalanced but also might not ...
0
votes
0answers
16 views

Specifiying threshold value for uncertainty sampling approach – active learning, machine learning

I need to implement a stream based uncertainty sampling mechanism which uses random forest as a classifier. Since I would like to improve my model (with the smallest possible amount of data) I would ...
0
votes
1answer
11 views

Active learning with a unlabelled pool - standard references & model-based labelling of the pool?

I'm looking into active learning for a multi-class classification problem, where there is a large pool of unlabelled data. I start out with a small set of labelled data and can labelled some more of ...
0
votes
1answer
19 views

Notation in definition of a quantity involving uncertainty and posterior probability

As a probs & stats noob, I'm still getting confused by notation. I would appreciate if someone could elaborate a bit on what's going on here, on p12 of Settles' Active Learning survey (2012). He ...
0
votes
0answers
24 views

Using active learning to polish the accuracy after learning from a dataset

I am trying to create a prediction model which would return a numerical score upon receiving a set of representative numbers. The purpose was to replicate human quality assessment procedure upon ...
0
votes
0answers
42 views

Are there clustering algorithms which require a human as an oracle?

Are there data clustering algorithms which by definition require human judgement as part of the algorithm? What I mean is that once in a while the algorithm presents the human operator (or any other ...