Questions tagged [multi-class]

Multiclass classification is a classification task in which there are more than two classes. It is also called multinomial classification.

Filter by
Sorted by
Tagged with
1
vote
0answers
12 views

Which loss function is the best for muticlass ordinal model?

I have a deep-learning model, where you can predict 5 different class (0-4). I want a model that punishes predictions that are more wrong. So if the model predicts 3 and it is a 4, it's not as bad as ...
0
votes
0answers
30 views

The effect of an imbalanced dataset on multi-class log loss in an imbalanced population

I have sampled data and labeled it as being 1 of 14 classes. This dataset is very imbalanced, e.g. I have a lot of samples for class 1 and not that many for class 14. However, this same imbalance is ...
0
votes
1answer
27 views

Is there any model that can handle time ordered multi classification?

I'm working on a little project and the task's the following: There are transactions for 16 products and ~75.000 clients on a 18-month time series, where each row is one transaction from one client-...
0
votes
0answers
7 views

Is it possible to identify which features contribute to the precision and recall for each label in sklearn's classification report output?

Below is an example of classification report output by sklearn. Is there an easy way to identify which features contribute to the precision and recall improvement for each label? I can start with ...
0
votes
0answers
6 views

Text MultiClass Classification - How many labels needed

I have a dataset similar in build to a product - category list with 5 categories and 2000 labelled products. I am new to ML but was wondering what the best approach for classification with limited ...
0
votes
0answers
51 views

How to report a confidence score of a multiclass classifier?

If we have a model which outputs class probabilities for $K$ classes, e.g. a NN with softmax layer, how can we return an aggregate "confidence metric"? Some intuitive ideas would be the ...
1
vote
0answers
319 views

Precision-Recall Curve Intuition for Multi-Class Classification

I am running a CNN image multi-class classification model with Keras/Tensorflow and have established about a 90% overall accuracy with my best model trial. I have 10 unique classes I am trying to ...
1
vote
1answer
22 views

What is a good model for heavy multiclass problem and small number of (textual) features? [closed]

I have a data set with a small number of textual features (less than 10) and a response variable with a lot of classes (~100). Is there any recommendation for models that are powerful for this kind of ...
0
votes
1answer
57 views

Random forest hyperparameter to control misclassification

May I know what hyperparameter to tune for random forest classifier to control misclassification? I'm doing a 5-class classification problem and it turns out that most classes are been misclassified ...
0
votes
0answers
32 views

SVM predicts always the same class

I have a dataset with tf-idf values and their corresponding classes and I am trying to do predictions using SVM. The problem is that all the results that it produces have the same class. Most related ...
0
votes
0answers
24 views

DL model for solving a multi-class classification problem works fine for the first class and then the performance gradually drops for other classes

I designed an AE shaped deep neural network to perform a multi-label class classification. The classes are not mutually exclusive. The last layer has n neurons; one responsible for each class. I pass ...
0
votes
0answers
31 views

multi-label classification in keras with huge number of classes

I have a training data of shape (100000,1200) and associated classes of size 3000. i.e, each sample has 1200 features and has to be mapped to one of the 3000 classes. How many hidden layers are ...
0
votes
0answers
12 views

Metrics to optimize imbalanced multiclass classification [duplicate]

I am working on a problem regarding authorship-attribution. Our multilabel (three possible authors) data set is highly imbalanced. We already took steps to solve the class-imbalance problem (by ...
0
votes
0answers
19 views

Classification with sub categories

I am wondering what the best strategy is for classifying data into multiple categories with sub-categories. For example, let's say I measure several parameters from some individuals. I categorise them ...
0
votes
1answer
239 views

Multiclass classification cross validation

Suppose that I am doing a multiclass classfication problem where some of the classes only occupies a very low percent of the whole training data. It is possible that when I divide it into k folds, ...
0
votes
0answers
58 views

Random forest to predict class probability based on sample data with multiple categories per sample

I have a dataset with plant families that are present in a plot survey. There are multiple locations (>17), and multiple replicate samples at a location (>4), and multiple sampling dates (9). ...
1
vote
1answer
77 views

Cox proportional hazards with multiclass dependent variable

Is it possible to perform a multiclass Cox proportional hazards model? I'm interested in finding the probability of self cure on consumer loans, or just study how self-curing clients behave so as to ...
0
votes
0answers
22 views

Neural network performs well on test but classifies completely the opposite when used to classify on training data

I have a neural network that is being used to classify three classes -1, 0, 1. It going to be applied to time series data to determine a class at each time point to ...
0
votes
0answers
31 views

Need statistical features of time series for classfication

I have a time series classification task to solve, based on statistical features like maximum, minimum, standard deviation, etc. It is a multiclass classification and my estimator seems to be confused ...
0
votes
0answers
59 views

Compare multi-label and multi-class results

During the last week I did a lot of research on how solve multi-label classification problems. One of the methods to solve this is by training a multi-class classifier on a Label-Powerset. So I ended ...
3
votes
0answers
77 views

Sample size vs F1-score, which is more important (small sample size)

I work in a filed were there are many publications based on classifiers trained on small samples sizes (but large amount of features). In most cases the sample size can only be increased by a few ...
0
votes
0answers
24 views

How to create an ROC model using three classes

I am trying to create a ROC plot based on response variable with three classes. I believe that is possible based on the answer to this question Here. In the answer provide in this question though, ...
1
vote
1answer
44 views

Obtaining Raw Probabilities From OVR Logistic Regression

I am relatively new to machine learning and I am working on a multi-class classification problem. I am attempting to utilize OVR logistic regression. When you run through an OVR model, the end result ...
1
vote
1answer
116 views

Multi-class classification with prior knowledge of class similarity?

Backrounds I would like to build a model that predicts a month label $\mathbf{y}$ from a given set of features $\mathbf{X}$. Data structure is as follows. $\mathbf{X} : N_{samples} \times N_{features}...
0
votes
0answers
57 views

NLP multiclass classification with many sparse classes

I am attempting to use natural language processing to geocode "addresses". The address is the result of a write-in of a survey where the respondent is instructed to give their city, state, ...
1
vote
1answer
36 views

Possible reason for high accuracy model

I have developed a multi-class Random forest model and it’s working great (well, almost too good). I am getting very high accuracy, sometimes even 1. But I am kind of suspicious about this result. ...
0
votes
0answers
51 views

Increase in SVM Classifier performance after binning

I've been working on a classification problem, and I ran into something rather strange. The original problem has continuous features and three labels. I then mapped the continuous features to binary ...
0
votes
1answer
160 views

Multi-class evaluation: found different macro F1 scores, which one to use?

I want to evaluate my multi-class classifier against a gold reference and obtain a single score that reflects its performance. In my data I have many classes that are important but rare, so I was ...
1
vote
0answers
22 views

Classification model to classify large number of classifiers?

Hello I am very new into the field of machine learning/deep learning , and I am finding it hard to select the right model for my research. What I am trying to build is a model to classify which ...
0
votes
1answer
26 views

How to get boundary points that are at interface of differnet classes in multilabel classification dataset

I am working on finding points which are at boundary of different classes. In other words finding points on which a classifier would be most confused or uncertain about. For a setting like multi label ...
0
votes
0answers
33 views

What are the best metrics to evaluate a multiclass classification model? [duplicate]

I have a multiclass classification problem I have 5 classes and data highly unbalnced class 01: 6 class 02: 100 class 03: 9300 class 04: 200 class 05: 34 I have used K fold cross validation ...
1
vote
1answer
45 views

Multi-class classification - confusing some classes is worse than others

I am quite a Rookie concerning machine learning and now thinking about the following problem: I want to assign a person to one out of 6 groups, let's say concerning their favorite colour --> works ...
2
votes
1answer
81 views

Using pos_weight to improve recall in a multi-class multi-label problem

I have a multi-label classification problem, and so I’ve been using the Pytorch's BCEWithLogitsLoss. I’d like to optimize my model for a higher F2 score, and so want to bias it to have greater recall (...
1
vote
1answer
1k views

Cumulative Matching Characteristic (CMC) curve for multiclass setting

The CMC curve is supposed to be calculated for a gallery and a probe set, both sets of vectors identifying some person. What if I train a model on a closed set of say 10 people with 10 samples (e.g. ...
1
vote
1answer
48 views

Select top-k feature from a categorical variable using $\chi^2$

I am working with a categorical variable that has a lot of levels (let's say more than 20). I would like to binarize all the levels doing one-hot-encoding in order to use these new variables in a ...
1
vote
0answers
176 views

Multi-class classification where classes have a ranking

I am trying to come up with a Machine Learning based solution for a situation that involves automatically classifying a number of people into 4 classes - Class 1, Class 2 , Class 3 and Class 4. The ...
1
vote
0answers
21 views

when is it better to use One Vs All and when to use One Vs One in Statistics and Machine Learning?

I would love to further understand the uses and the application because while I understand the difference I still don't know which one is better for which type of problem.
2
votes
0answers
71 views

Is better to use a multiclass classifier or a set of binary classifiers?

I have to build a general method to perform multiclass classification. The number of class in the target variable is not fixed (it is probably in a range between 3 and 10). I would like to know if it ...
0
votes
1answer
199 views

Custom metrics for multiclass classification when class errors have different weights

I have a multiclass classification problem (eg. the target variable is made by 4 different outcomes: Product A, Product B, Product C and NO Product). Not all the errors are equal: for example, if the ...
1
vote
1answer
279 views

What is the difference between multi-class and multi-label classification? [duplicate]

What is the exact difference between multi-class and multi-label classification? For example, if you have a fridge with a camera that can view inside to see what products are still in stock, is this ...
0
votes
1answer
422 views

Threshold for LDA in the case of three classes

The result of discriminant analysis for the three classes are two discriminant functions LD1 and LD2. In the case of two classes, there is one discriminant function LD1, and the threshold of ...
1
vote
1answer
22 views

categorical distribution in validation set

I have a dataset that contains 6877 samples. This is a multiclass multilabel classification which means that we have 9 classes and every sample can belong to one or more of these classes. The total ...
0
votes
0answers
18 views

Level of Agree-ness in ensemble models

I am trying to analyze the output of multiple models (as in ensemble method), classifying a multiclass dataset. I would like to study the behavior of the models compared to each other when they are ...
0
votes
0answers
134 views

My CNN model is predicting with 100% confidence and only one class

I am training my CNN image classification model with keras and tensorflow backend. It has two outputs: dog, cat. I trained it with 12k images per class and then convert it from .h5 to .mlmodel for ...
1
vote
0answers
282 views

Improve F1-score for multiclass text classification with highly imbalanced dataset

I am trying to classify clients' complaints with a dataset of 180k complaints. I have 132 classes like this: Counter({'DIAG_000_NODIAG': 66291, 'FORWARD': 29126, 'DIAG_087': 22843, 'DIAG_049': 17668, ...
0
votes
0answers
77 views

Improving accuracy of multi-class text classifier

I am trying to build a text classifier with 4 highly imbalanced classes. Data has around 4000 documents and highly sparse. I have used XGboost and few other algorithms.Highest accuracy is given by ...
2
votes
0answers
547 views

Hessian Matrix for MultiClass Softmax in Gradient Boosting (XGBoost): $2p_i(1-p_i)$

In the context of MultiClass Softmax, for a particular training instance, label and prediction $y, p \in \mathbb{R}^K$ (K categories). The hessian matrix for Multiclass SoftMax with K categories is a $...
0
votes
0answers
10 views

Performing classification when the potential options of classes are different for every data row/user

I have a problem that I am trying to solve using ML but am not able to determine techniques, hence asking for advice. Appreciate your urgent response! I have a dataset of several users. Each user has ...
1
vote
0answers
179 views

Comparing multiclass AUC between two classifiers trained on the same data

I have fit two different multiclass classifiers on the same data, one is a multinomial logistic regression the other one a KNN Classifier. Now I want to know which one has a better fit in general. I ...
0
votes
1answer
479 views

How many data points per class is neccesary to train a multi-class deep learning model?

I have around 20,000 manually categorized texts into 500 classes. Around 150 of the classes have only one instance in the data. If I limit it to classes with at least 4 instances in the data, I get to ...

1
2
3 4 5
8