Skip to main content

All Questions

15 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4 votes
0 answers
1k views

Categorical cross-entropy vs Binary cross-entropy for multi-class classification with mixup

I understand that for multi-class classification the correct loss to use is categorical cross-entropy. However, when performing mixup as a regularisation technique two samples $(X_1, y_1)$ and $(X_2, ...
Avelina's user avatar
  • 1,188
3 votes
0 answers
545 views

What is a good loss function in multiclass multilabel classification where only one of the possible labels is observed?

I am training an ANN in multiclass multilabel scenario, where only one of the possible labels is observed at a time, let me illustrate on an example: I have a state X and the ground truth label Y for ...
Erhan's user avatar
  • 53
2 votes
0 answers
538 views

Similarity between Train and Test data sets

I have multiclass classification dataset and I am using Deep nets for the classification task. To explain the problem, let's assume that I have 5 classes to classify. No matter what I try, be it ...
Ambarish's user avatar
  • 199
1 vote
1 answer
27 views

Reason for softmax approximation in Ian Goodfellow's deep learning book

In section 6.2.2.2 (equation 6.31) they state: Overall, unregularized maximum likelihood will drive the model to learn parameters that drive the softmax to predict the fraction of counts of each ...
Philipp's user avatar
  • 11
1 vote
1 answer
37 views

Should I train my classifier with examples that are outside my classes of interest? And should I create an "others" class to handle them?

This is a 2 part question regarding a multi-class classifier based on a neural network that is expected to predict whether the input image has a cat or a dog. If shown something different (like a man),...
Augustine Charly's user avatar
1 vote
0 answers
184 views

Multi-class multi-label with partial mutual exclusivity

Given an input, I want to predict 0/1 for each of N output classes. The output can be 1 for multiple classes. So I'm training with individual binary cross-entropies for each of the output classes. ...
user342018's user avatar
1 vote
0 answers
32 views

Which loss function is the best for muticlass ordinal model?

I have a deep-learning model, where you can predict 5 different class (0-4). I want a model that punishes predictions that are more wrong. So if the model predicts 3 and it is a 4, it's not as bad as ...
Nastasija Maksimovic's user avatar
1 vote
0 answers
184 views

How to maximize subset accuracy for multilabel multiclass image classification

I working on multi-label multi-class image classification. I am using TensorFlow. Currently I am using sigmoid on output layer with binary_crossentrpy. Model is ...
Vivek Mehta's user avatar
1 vote
0 answers
499 views

Multi-class image segmentation with conflicting labels

I'm trying to perform multi-class semantic segmentation on a corpus made up of several sub-corpora. The difficult part is that across sub-corpora labels are not consistent. That is to say that similar ...
jbm's user avatar
  • 121
1 vote
1 answer
91 views

Neural Networks: How to do class prediction from murky labels

I'm conducting an experiment with the MNIST digit data - handwritten digits 0-9, each example composed of 28x28 bitmap of pixels. Imagine a collection of examples is drawn at random without class ...
Patrick McCarthy's user avatar
1 vote
0 answers
145 views

Learning separate models vs single model

I have seen in several texts that: "We learn separate models for each class/category". What does this mean and how is this different from learning a single model to classify all the classes?
Isam Abdullah's user avatar
0 votes
0 answers
55 views

How do I know which class has been difficult to learn for my multi-class model?

For a multi-class model, there are always chances that the model is learning one class's features more than the other. But how do I find which class has been weakly learned? Please help.
shey's user avatar
  • 11
0 votes
0 answers
522 views

Increasing precision for one label in multiclass classification

I am doing multiclass classification for 3 labell with neural net. The model works fine but when I check precision/recall per label in validation set I can see that precision is a little bit too low ...
jacekblaz's user avatar
0 votes
0 answers
27 views

Neural network performs well on test but classifies completely the opposite when used to classify on training data

I have a neural network that is being used to classify three classes -1, 0, 1. It going to be applied to time series data to determine a class at each time point to ...
Po Chen Liu's user avatar
0 votes
0 answers
595 views

Why not approach the Multi-Class Classification problem using Neural Networks as a model the same way it's approached with a Logistic Regression model

I can't seem to understand why when approaching a K-class classification problem using a Neural Network we take a different approach than any other classification model. I understand that in the ...
Andreas Theodoulou's user avatar