Questions tagged [multilabel]
Multi-label classification where multiple target labels might be assigned to each instance.
184
questions
1
vote
1
answer
15
views
What can cause one label in a multi-label classification task to have the highest score most of the times?
I have a multi-label classification task in which I have 7 categories per each sample. I train a multi-label classification model (i.e., XLMRobertaForSequenceClassification). When I evaluate the model ...
- 13
1
vote
1
answer
18
views
Ideal loss for a multi-label problem with soft targets
Given an input X, my goal is to predict a list of probabilities for n factors, where the factors could be attributes like ...
- 123
0
votes
0
answers
43
views
How to encode multiclass target variable?
I have a ML project for classifying news articles. In my dataset I have a target variable called "category", which represents type of the article, ("IT", "Science & Tech&...
- 101
4
votes
1
answer
119
views
How robust is multinomial logistic regression to having a multi-label problem shoehorned into it?
Consider a situation where there can be membership in group $A$, group $B$, both groups, or neither group. If we wanted to predict group membership probabilities from some covariate information, this ...
- 55.1k
1
vote
1
answer
38
views
Multi-label stratified split
I am working on a multilabel text classification problem.
The text data is called 'cleaned_text' and has shape (92259, 1) and the one-hot encoded label data is called 'labels' and has shape (92259, 32)...
- 231
1
vote
1
answer
31
views
Multilabel classification problem
I have a problem statement where I have two dataset one labeled where a data point can belong to only one class say class1 or class2 and there's another unlabeled dataset. Now for unlabeled dataset I ...
- 11
0
votes
0
answers
19
views
AUC for Multi-Label Classification using SVM
I am tackling a multi-label classification problem and I want to choose a SVM model maximising the AUC. I am not sure if AUC can be used in this case and if yes it is sufficient just to change the ...
0
votes
1
answer
25
views
Multilabel Classification Task using SVM
I want to classify diabetic retinopathy grades (normal, mild, moderate, severe, PDR) using SVM.
But the problem is i don't know which type of svm should i use, because i extract three lession features ...
- 21
0
votes
0
answers
76
views
Sampling strategies in multi-target classification
I am dealing with multi-target binary classifications (I have two targets). I need to use a sampling strategy. I have tried imblearn.pipeline but I'm getting the same error as this time when I'm ...
- 135
0
votes
1
answer
30
views
Evaluating classifier with 2 labels and 'unknown' label
The classifier I'm using has 3 possible label outputs - POSITIVE, NEGATIVE or UNKNOWN. For training data, the labels are only POSITIVE and NEGATIVE.
What is the best way to handle evaluating the ...
- 95
0
votes
0
answers
15
views
How measure feature association when you deal with multilabel target AND multilabel features?
I have a dataset of categorical multilabel targets AND features. My target is multilabel and I observe a large overlap of classes between sets. I have several features for each row that may or may not ...
0
votes
0
answers
15
views
Flipping inputs in multilabel classification
I have framed a classification problem as follows:
I have $N$ items, and wish to predict a set of relevant tags for each out of $M$ tags. An item can have anywhere from 0 to $M$ applicable tags.
To ...
- 1
0
votes
0
answers
12
views
Text Labeling with 5 Annotators
for a study I let participants classify a text into 3 categories [0,1,2]. Every text got 5 annotations.
So my assumption is now, that the score of Krippendorff's Alpha or Fleiss Kappa decreases, the ...
0
votes
1
answer
315
views
Multi-Label Classification where each label is a Multi-class problem
Problem:
Currently, I have 15 classification models(multi-class + binary). Training and Maintaining 15 models take a huge time and cost. Also, I need to inference 15 models for every input. So I ...
- 176
0
votes
0
answers
20
views
Multi-class Discovery and Classification From Noisy Dataset
I have a set of multiple audio recordings of someone reciting 10 word sentences. There are 3 different sentences, and ~50 recordings of recitations per each different sentence. Each individual ...
- 101
0
votes
0
answers
155
views
Grouped stratified train-val-test split for a multilabel dataset
I was wondering if there is a fast heuristic algorithm for performing grouped stratified dataset split on a multilabel dataset. Question originally posted on Data Science stackexcahnge here.
...
- 21
1
vote
1
answer
35
views
One text classification model, two sets of target classes
I am attempting to classify text sequences into two sets of labels - class_1 = [A, B, C, D], class_2 = [X, Y, Z]. The model will ...
- 385
0
votes
0
answers
21
views
How to solve a multi-class and multi-label classification?
im trying to classify a picture of columns with 4 squares that need to be marked and 26 question that represent a Multi Choice Question exam
each question labeled like this:
[],[],[],[X] -> 1, [X],[...
- 1
0
votes
0
answers
77
views
How to interpret the values returned by TreeShap for multilabel classification?
I have read in Molnar (2022) and Gianfagna (2021) books that the TreeShap method returns the exact Shapley values of Shapley (1951).
The Shapley value estimates, given the current set of feature ...
- 101
0
votes
0
answers
34
views
How do I know which class has been difficult to learn for my multi-class model?
For a multi-class model, there are always chances that the model is learning one class's features more than the other. But how do I find which class has been weakly learned? Please help.
- 11
0
votes
0
answers
271
views
Multilabel Classification: Accuracy is very low. Metric or Model, which is inadequate?
In my multilabel classifaction problem, which I approach similarly to what can be see in this post: How does Keras handle multilabel classification?, the resulting accuracy only increases from 2% to 5%...
- 101
0
votes
0
answers
13
views
How to find related tags for a given tag, given a set of tagged documents?
Given a set of documents with tags, what would be a sound way of finding out how related two given tags are?
Obviously, we can look at the number of documents that share both tags. However, tag A ...
0
votes
1
answer
65
views
What kind of architecture to use for non-binary output multi-label image clasification
I want to make a network for making multi-label attribute classifications on images of clothing.
This is a simplified case of what I want to do, I have 9 different attribute categories that I wish to ...
- 101
0
votes
0
answers
13
views
Bulding a labelling dataset and modelling categorical features
Summary: How do I ensure that sample I create for labelling is representative enough and would be appropriate for modelling, given I cannot include all feature combinations in it.
I have a tabular ...
0
votes
0
answers
132
views
What loss function to use for multi-label classification?
I am training a model that determines what attributes a piece of cloth has.
The labels, for example, look something like [0, 1, 0, 0, 1], each index indicating a ...
7
votes
2
answers
246
views
What is the statistical model for a multi-label problem?
In a setting with a binary $y$ like dog/cat, a reasonable statistical model is to posit that the probability parameter $p$ of a $\text{Binomial}(1, 0)$ distribution is some function $f$ of features $X$...
- 55.1k
1
vote
1
answer
511
views
Using Hamming Loss for multi-label classification with imbalaned class and many labels
I'm working on a multi-label classification problem where I want to classify text into 20 categories, and each text may belong to one or multiple categories. Each category is a binary value of 0 or 1, ...
- 151
2
votes
0
answers
190
views
Efficient method for tuning threshold in multi-label classification
Given a multi-label classifier, e.g. multi-label image segmentation, what are some typical strategies/libraries to help tune the class label threshold in order to maximize some metric, such as F1-...
- 21
1
vote
1
answer
76
views
CNN for multi-class classification with occasional multi-labels
I have about 10 classes, on which I train a CNN with a softmax output layer using one-hot encoding and categorical cross-entropy loss.
The problem is that two pairs of these of these classes (let's ...
- 131
1
vote
0
answers
69
views
How to update multi-label classification prediction with extra information on the probability of a label occurring, given the other labels
I think this question is best expressed directly with an example.
Let us say I have a picture of a dog in a lease in the park, and an algorithm for object recognition splits the following labels with ...
- 11
0
votes
0
answers
60
views
Multi-label Classification without any training data
How can I perform multi-label classification without any training data i.e. just using candidate labels like zero-shot-learning? I was able to perform single label classification using only candidate ...
2
votes
1
answer
555
views
How to predict both category and sub category in machine learning classification?
There are 4 actions available. Each action has its own varying number of categories.
The target is to predict an action along with the category of action, given input data.
Assume actions are a,b,c,d
...
- 21
0
votes
0
answers
2k
views
what are the typical loss function for multi-label classification with dependent classes
For multi-label (multi-class) classification task, it seems to me that the standard loss to use is the binary cross entropy loss. However, it assumes that the the classes are independent and we are ...
- 311
1
vote
0
answers
141
views
Multi-class multi-label with partial mutual exclusivity
Given an input, I want to predict 0/1 for each of N output classes. The output can be 1 for multiple classes. So I'm training with individual binary cross-entropies for each of the output classes. ...
- 11
1
vote
0
answers
383
views
Difference between Hamming Loss, Hamming Score, and Hamming Distance in multiclass multilabel classification
I am trying to understand the mathematical difference between, Hamming distance, Hamming Loss and Hamming score. I am trying to perform two actions
Multiclass multi label classification using SVM
K ...
0
votes
0
answers
798
views
under sampling a multi-label dataset
I have a multi-label dataset, whose label distribution looks something like this, with label on x-axis and number of rows it occurs in the dataset in y-axis.
...
1
vote
0
answers
29
views
Multi-label classification where predicting any one label is fine
I am working on a problem with muti-label classification, where, in contrast to the conventional requirement that the correct prediction of each label is expected, we just need to predict ANY ONE of ...
- 131
0
votes
0
answers
17
views
How to get multiple outputs using classification techniques?
I want to predict roles based on technical skills column.I have column technical skills for ...
- 63
0
votes
0
answers
43
views
Which model to use for multiple outputs in classification problem
I want to predict roles based on name, experience, soft skills, technical skills . Based on all these variables I want to ...
- 63
1
vote
1
answer
69
views
how train AdaBoost M1 weak estimators?
I'm trying to implement AdaBoost.M1 as explained in Boosting: Foundations and Algorithms by Robert E. Schapire and Y. Freund. The problem is that I don't understand at each iteration t the estimator ...
- 131
2
votes
1
answer
121
views
How can I combine the scores of a multilabel classifier?
I have a keras neural network with 8 outputs and it is a multilabel problem, which means that an observation can be classified into more than one target class.
Let's suppose I have the following ...
1
vote
0
answers
25
views
Am I doing correct unit test before whole batch training?
I read somewhere that unit tests are important before jumping onto training for the whole batch. And for that reason, if one sample overfits on the model, can we decisively say that the training will ...
- 106
0
votes
1
answer
112
views
effective labelling in multilabel classification
I am working on a multilabel classification problem with 44 features and 2 labels. Label2 is a binary (0,1) and Label1 had label encoding done on it up to ten (1,2...10).
I did one-hot encoding on ...
- 103
1
vote
0
answers
72
views
Make use of wrong label in learning?
I have a dataset. Each sample has two labels. The labels in the first set are mostly correct (>90%). The other labels, say annotated by an inexperienced annotator, are mostly incorrect, but they ...
- 11
0
votes
1
answer
647
views
One Multi-Label Classifier or Two Single-Label Classifier?
I have a dataset that each feature in a data could have two separate labels depending on separate definitions. According to definition 1, each feature could have one of two labels (A, B). According to ...
- 189
1
vote
1
answer
519
views
Dealing with outliers and correlated features for a deep learning based classification problem
I am working on a multi-label multi-class classification problem that required me to use deep learning based approach. The data has around 17000 examples where each example has 42 numerical features ...
- 11
1
vote
0
answers
627
views
Error "Feature names stored in `object` and `newdata` are different!" using xgboost in mlr package [closed]
I am trying to make a multilabel classification model for XGBoost. I have one that works for RF, but when I try this code below for XGBoost I get the error:
...
- 11
1
vote
0
answers
39
views
How to tell if a model is overfitting or underfitting or the problem is something entirely different
I'm a complete beginner and I'm trying to do a multi-label classification on the well known dataset ChestX-ray14, which contains about 112 thousand x-ray images from about 31 thousand patients, the ...
1
vote
0
answers
65
views
How to measure agreement with categorical labels, and with multiple binary labels?
I have a dataset in which 7 coders have given a categorical label to each of 152 objects. The same 8 categories are selected between for all objects. I would like to measure the agreement between ...
- 11
1
vote
0
answers
233
views
Why Binary Cross Entropy is more suitable than Categorical Cross Entropy in multi label classification?
I found this answers. But, I don't get fully. If I have three labels in multi label classification task, did BCE produce 3 separate outputs? Why we shouldn't use CCE?
In this Facebook work they claim ...
- 11