Questions tagged [multilabel]

Multi-label classification where multiple target labels might be assigned to each instance.

Filter by
Sorted by
Tagged with
1 vote
1 answer
15 views

What can cause one label in a multi-label classification task to have the highest score most of the times?

I have a multi-label classification task in which I have 7 categories per each sample. I train a multi-label classification model (i.e., XLMRobertaForSequenceClassification). When I evaluate the model ...
A User's user avatar
  • 13
1 vote
1 answer
18 views

Ideal loss for a multi-label problem with soft targets

Given an input X, my goal is to predict a list of probabilities for n factors, where the factors could be attributes like ...
OlorinIstari's user avatar
0 votes
0 answers
43 views

How to encode multiclass target variable?

I have a ML project for classifying news articles. In my dataset I have a target variable called "category", which represents type of the article, ("IT", "Science & Tech&...
CraZyCoDer's user avatar
4 votes
1 answer
119 views

How robust is multinomial logistic regression to having a multi-label problem shoehorned into it?

Consider a situation where there can be membership in group $A$, group $B$, both groups, or neither group. If we wanted to predict group membership probabilities from some covariate information, this ...
Dave's user avatar
  • 55.1k
1 vote
1 answer
38 views

Multi-label stratified split

I am working on a multilabel text classification problem. The text data is called 'cleaned_text' and has shape (92259, 1) and the one-hot encoded label data is called 'labels' and has shape (92259, 32)...
Steven Gubkin's user avatar
1 vote
1 answer
31 views

Multilabel classification problem

I have a problem statement where I have two dataset one labeled where a data point can belong to only one class say class1 or class2 and there's another unlabeled dataset. Now for unlabeled dataset I ...
Sujit Kumar's user avatar
0 votes
0 answers
19 views

AUC for Multi-Label Classification using SVM

I am tackling a multi-label classification problem and I want to choose a SVM model maximising the AUC. I am not sure if AUC can be used in this case and if yes it is sufficient just to change the ...
data_miner_frbg's user avatar
0 votes
1 answer
25 views

Multilabel Classification Task using SVM

I want to classify diabetic retinopathy grades (normal, mild, moderate, severe, PDR) using SVM. But the problem is i don't know which type of svm should i use, because i extract three lession features ...
anastasia's user avatar
0 votes
0 answers
76 views

Sampling strategies in multi-target classification

I am dealing with multi-target binary classifications (I have two targets). I need to use a sampling strategy. I have tried imblearn.pipeline but I'm getting the same error as this time when I'm ...
Hanna's user avatar
  • 135
0 votes
1 answer
30 views

Evaluating classifier with 2 labels and 'unknown' label

The classifier I'm using has 3 possible label outputs - POSITIVE, NEGATIVE or UNKNOWN. For training data, the labels are only POSITIVE and NEGATIVE. What is the best way to handle evaluating the ...
filaments's user avatar
0 votes
0 answers
15 views

How measure feature association when you deal with multilabel target AND multilabel features?

I have a dataset of categorical multilabel targets AND features. My target is multilabel and I observe a large overlap of classes between sets. I have several features for each row that may or may not ...
beginner_DE's user avatar
0 votes
0 answers
15 views

Flipping inputs in multilabel classification

I have framed a classification problem as follows: I have $N$ items, and wish to predict a set of relevant tags for each out of $M$ tags. An item can have anywhere from 0 to $M$ applicable tags. To ...
John's user avatar
  • 1
0 votes
0 answers
12 views

Text Labeling with 5 Annotators

for a study I let participants classify a text into 3 categories [0,1,2]. Every text got 5 annotations. So my assumption is now, that the score of Krippendorff's Alpha or Fleiss Kappa decreases, the ...
Maxl Gemeinderat's user avatar
0 votes
1 answer
315 views

Multi-Label Classification where each label is a Multi-class problem

Problem: Currently, I have 15 classification models(multi-class + binary). Training and Maintaining 15 models take a huge time and cost. Also, I need to inference 15 models for every input. So I ...
Naren Babu R's user avatar
0 votes
0 answers
20 views

Multi-class Discovery and Classification From Noisy Dataset

I have a set of multiple audio recordings of someone reciting 10 word sentences. There are 3 different sentences, and ~50 recordings of recitations per each different sentence. Each individual ...
superuser's user avatar
  • 101
0 votes
0 answers
155 views

Grouped stratified train-val-test split for a multilabel dataset

I was wondering if there is a fast heuristic algorithm for performing grouped stratified dataset split on a multilabel dataset. Question originally posted on Data Science stackexcahnge here. ...
jasperhyp's user avatar
1 vote
1 answer
35 views

One text classification model, two sets of target classes

I am attempting to classify text sequences into two sets of labels - class_1 = [A, B, C, D], class_2 = [X, Y, Z]. The model will ...
KOB's user avatar
  • 385
0 votes
0 answers
21 views

How to solve a multi-class and multi-label classification?

im trying to classify a picture of columns with 4 squares that need to be marked and 26 question that represent a Multi Choice Question exam each question labeled like this: [],[],[],[X] -> 1, [X],[...
Escaban's user avatar
0 votes
0 answers
77 views

How to interpret the values returned by TreeShap for multilabel classification?

I have read in Molnar (2022) and Gianfagna (2021) books that the TreeShap method returns the exact Shapley values of Shapley (1951). The Shapley value estimates, given the current set of feature ...
db_max's user avatar
  • 101
0 votes
0 answers
34 views

How do I know which class has been difficult to learn for my multi-class model?

For a multi-class model, there are always chances that the model is learning one class's features more than the other. But how do I find which class has been weakly learned? Please help.
shey's user avatar
  • 11
0 votes
0 answers
271 views

Multilabel Classification: Accuracy is very low. Metric or Model, which is inadequate?

In my multilabel classifaction problem, which I approach similarly to what can be see in this post: How does Keras handle multilabel classification?, the resulting accuracy only increases from 2% to 5%...
Viktor's user avatar
  • 101
0 votes
0 answers
13 views

How to find related tags for a given tag, given a set of tagged documents?

Given a set of documents with tags, what would be a sound way of finding out how related two given tags are? Obviously, we can look at the number of documents that share both tags. However, tag A ...
Desk Reference's user avatar
0 votes
1 answer
65 views

What kind of architecture to use for non-binary output multi-label image clasification

I want to make a network for making multi-label attribute classifications on images of clothing. This is a simplified case of what I want to do, I have 9 different attribute categories that I wish to ...
isa türk's user avatar
  • 101
0 votes
0 answers
13 views

Bulding a labelling dataset and modelling categorical features

Summary: How do I ensure that sample I create for labelling is representative enough and would be appropriate for modelling, given I cannot include all feature combinations in it. I have a tabular ...
Dimitar Argirov's user avatar
0 votes
0 answers
132 views

What loss function to use for multi-label classification?

I am training a model that determines what attributes a piece of cloth has. The labels, for example, look something like [0, 1, 0, 0, 1], each index indicating a ...
Vandalious's user avatar
7 votes
2 answers
246 views

What is the statistical model for a multi-label problem?

In a setting with a binary $y$ like dog/cat, a reasonable statistical model is to posit that the probability parameter $p$ of a $\text{Binomial}(1, 0)$ distribution is some function $f$ of features $X$...
Dave's user avatar
  • 55.1k
1 vote
1 answer
511 views

Using Hamming Loss for multi-label classification with imbalaned class and many labels

I'm working on a multi-label classification problem where I want to classify text into 20 categories, and each text may belong to one or multiple categories. Each category is a binary value of 0 or 1, ...
crx91's user avatar
  • 151
2 votes
0 answers
190 views

Efficient method for tuning threshold in multi-label classification

Given a multi-label classifier, e.g. multi-label image segmentation, what are some typical strategies/libraries to help tune the class label threshold in order to maximize some metric, such as F1-...
kevqnp's user avatar
  • 21
1 vote
1 answer
76 views

CNN for multi-class classification with occasional multi-labels

I have about 10 classes, on which I train a CNN with a softmax output layer using one-hot encoding and categorical cross-entropy loss. The problem is that two pairs of these of these classes (let's ...
Paul92's user avatar
  • 131
1 vote
0 answers
69 views

How to update multi-label classification prediction with extra information on the probability of a label occurring, given the other labels

I think this question is best expressed directly with an example. Let us say I have a picture of a dog in a lease in the park, and an algorithm for object recognition splits the following labels with ...
Carlos_San's user avatar
0 votes
0 answers
60 views

Multi-label Classification without any training data

How can I perform multi-label classification without any training data i.e. just using candidate labels like zero-shot-learning? I was able to perform single label classification using only candidate ...
Ujjwal Karnani's user avatar
2 votes
1 answer
555 views

How to predict both category and sub category in machine learning classification?

There are 4 actions available. Each action has its own varying number of categories. The target is to predict an action along with the category of action, given input data. Assume actions are a,b,c,d ...
MrSpectre's user avatar
0 votes
0 answers
2k views

what are the typical loss function for multi-label classification with dependent classes

For multi-label (multi-class) classification task, it seems to me that the standard loss to use is the binary cross entropy loss. However, it assumes that the the classes are independent and we are ...
Ryan's user avatar
  • 311
1 vote
0 answers
141 views

Multi-class multi-label with partial mutual exclusivity

Given an input, I want to predict 0/1 for each of N output classes. The output can be 1 for multiple classes. So I'm training with individual binary cross-entropies for each of the output classes. ...
user342018's user avatar
1 vote
0 answers
383 views

Difference between Hamming Loss, Hamming Score, and Hamming Distance in multiclass multilabel classification

I am trying to understand the mathematical difference between, Hamming distance, Hamming Loss and Hamming score. I am trying to perform two actions Multiclass multi label classification using SVM K ...
Srinag Vinil Tummala's user avatar
0 votes
0 answers
798 views

under sampling a multi-label dataset

I have a multi-label dataset, whose label distribution looks something like this, with label on x-axis and number of rows it occurs in the dataset in y-axis. ...
Naveen Reddy Marthala's user avatar
1 vote
0 answers
29 views

Multi-label classification where predicting any one label is fine

I am working on a problem with muti-label classification, where, in contrast to the conventional requirement that the correct prediction of each label is expected, we just need to predict ANY ONE of ...
Jeff's user avatar
  • 131
0 votes
0 answers
17 views

How to get multiple outputs using classification techniques?

I want to predict roles based on technical skills column.I have column technical skills for ...
10sha25's user avatar
  • 63
0 votes
0 answers
43 views

Which model to use for multiple outputs in classification problem

I want to predict roles based on name, experience, soft skills, technical skills . Based on all these variables I want to ...
10sha25's user avatar
  • 63
1 vote
1 answer
69 views

how train AdaBoost M1 weak estimators?

I'm trying to implement AdaBoost.M1 as explained in Boosting: Foundations and Algorithms by Robert E. Schapire and Y. Freund. The problem is that I don't understand at each iteration t the estimator ...
Mehdi Abbassi's user avatar
2 votes
1 answer
121 views

How can I combine the scores of a multilabel classifier?

I have a keras neural network with 8 outputs and it is a multilabel problem, which means that an observation can be classified into more than one target class. Let's suppose I have the following ...
Matheus Nascimento's user avatar
1 vote
0 answers
25 views

Am I doing correct unit test before whole batch training?

I read somewhere that unit tests are important before jumping onto training for the whole batch. And for that reason, if one sample overfits on the model, can we decisively say that the training will ...
banikr's user avatar
  • 106
0 votes
1 answer
112 views

effective labelling in multilabel classification

I am working on a multilabel classification problem with 44 features and 2 labels. Label2 is a binary (0,1) and Label1 had label encoding done on it up to ten (1,2...10). I did one-hot encoding on ...
Ahmed Anwer's user avatar
1 vote
0 answers
72 views

Make use of wrong label in learning?

I have a dataset. Each sample has two labels. The labels in the first set are mostly correct (>90%). The other labels, say annotated by an inexperienced annotator, are mostly incorrect, but they ...
quasquas's user avatar
0 votes
1 answer
647 views

One Multi-Label Classifier or Two Single-Label Classifier?

I have a dataset that each feature in a data could have two separate labels depending on separate definitions. According to definition 1, each feature could have one of two labels (A, B). According to ...
LCheng's user avatar
  • 189
1 vote
1 answer
519 views

Dealing with outliers and correlated features for a deep learning based classification problem

I am working on a multi-label multi-class classification problem that required me to use deep learning based approach. The data has around 17000 examples where each example has 42 numerical features ...
Meghal Darji's user avatar
1 vote
0 answers
627 views

Error "Feature names stored in `object` and `newdata` are different!" using xgboost in mlr package [closed]

I am trying to make a multilabel classification model for XGBoost. I have one that works for RF, but when I try this code below for XGBoost I get the error: ...
agnesg2g's user avatar
1 vote
0 answers
39 views

How to tell if a model is overfitting or underfitting or the problem is something entirely different

I'm a complete beginner and I'm trying to do a multi-label classification on the well known dataset ChestX-ray14, which contains about 112 thousand x-ray images from about 31 thousand patients, the ...
Enkhtaivan Ganbat's user avatar
1 vote
0 answers
65 views

How to measure agreement with categorical labels, and with multiple binary labels?

I have a dataset in which 7 coders have given a categorical label to each of 152 objects. The same 8 categories are selected between for all objects. I would like to measure the agreement between ...
Ben Jones's user avatar
1 vote
0 answers
233 views

Why Binary Cross Entropy is more suitable than Categorical Cross Entropy in multi label classification?

I found this answers. But, I don't get fully. If I have three labels in multi label classification task, did BCE produce 3 separate outputs? Why we shouldn't use CCE? In this Facebook work they claim ...
1chimaruGin's user avatar