Linked Questions

1
vote
0answers
2k views

Repeating rare examples in unbalanced data classification [duplicate]

So I'm trying to train a neural network for a rare event detection. Based on that, I have like 1000 times more examples for non-target (everything else) examples that I have for target examples. So I ...
16
votes
0answers
309 views

Are unbalanced datasets problematic, and (how) does oversampling (purport to) help? [duplicate]

TL;DR See title. Motivation I am hoping for a canonical answer along the lines of "(1) No, (2) Not applicable, because (1)", which we can use to close many wrong questions about unbalanced datasets ...
0
votes
1answer
448 views

Does it make sense to up-sample imbalanced data if I care about predicting the right probabilities? [duplicate]

I'm developing a predictive model on a dataset of about 25K observations with the response variable having ~60 classes. There are ~130 predictor variables, all of them binary. In this problem I care ...
2
votes
0answers
232 views

Why imbalance in the data set is an issue in data mining and machine learning? [duplicate]

I've analyzed a data set from a credit card company before and it has the famous "unbalanced classes" problem like all the other credit card companies, i.e., in the data set (the information of users ...
2
votes
1answer
180 views

When do we speak of imbalanced data? [duplicate]

I was wondering, what the threshold is for a dataset to be called 'imbalanced'? Technically every dataset where the target-classes aren't evenly distributed is not balanced. Yet small imbalance ...
2
votes
2answers
78 views

Does the ratio of training data (significantly) affects the result? [duplicate]

Say I have two training data of email titles with 10000 entries each. One of them have 2000 ham and 8000 spam, while the other have 5000 ham and 5000 spam. Will predicting any random email with the 2:...
1
vote
0answers
172 views

Classification model on a highly unbalanced dataset [duplicate]

I’m dealing with a highly unbalanced dataset where 20% of data belongs to class A and 80% belongs to class B. It’s very hard for us to produce synthetic class A data. Just wondering if the below ...
1
vote
0answers
148 views

positive and negative sample count for ConvNets [duplicate]

I have been trying to set up a ConvNet to classify some data. This data should be classified to either 1 (being what I need to get from the image) and 0 for everything that is irrelevant. I have ...
0
votes
0answers
48 views

Handling imbalanced data for classification [duplicate]

What are the best ways to deal with imbalanced datasets for classifying whether or not individuals pay their tuition? The data is 75% positive class (paid) and 25% negative (unpaid). Some approaches I ...
0
votes
0answers
45 views

Choosing better samples for downsampling [duplicate]

I'm training a classification model for highly unbalanced data where hits are pairs that have similarity of almost 1 on independent metric. Everything else are non hits. Does it make sense to pick ...
1
vote
0answers
37 views

While dealing with imbalanced classes, to what extent can we upsample a minority class? [duplicate]

I have my training data with the following approximate distribution: Negative events : 90,000 positive events : 5,000 Training a model would require to oversample the minority class (and might also ...
0
votes
0answers
34 views

unbalaced data set in classification tasks [duplicate]

How do I judge whether the dataset is unbalanced (is it when the minority class inferior of 15%) could us use the test CR after balancing the data?
1
vote
0answers
23 views

Risks of disproportionate numbers of training examples for different classes? [duplicate]

fairly new to machine learning so please be gentle! I was wondering what the risks might be if I have significantly more examples for one class than the other when training a 2-D perceptron; for ...
0
votes
0answers
18 views

At which threshold is unbalanced data a problem for a binary classification tree? [duplicate]

I want to build a binary classification tree to clasfiy wether a person is working or not and use the model for prediction. I read that unbalanced data could be a problem. Now i ask myself at which ...
0
votes
0answers
16 views

Will more training data of one class destroy the good model? [duplicate]

I am facing a binary classification problem that I don't know I should use more data or not. I have one label 'A' with 10 training examples. And another label 'B' with also 10 training examples. By ...

15 30 50 per page