Questions tagged [under-sampling]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
0answers
17 views

Undersampling of datasets and training the model using early stopping

I need some clarification on the undersampling of datasets. I have 3 datasets. Undersampled train data, undersampled validation data, and test dataset which is not undersampled and is the true ...
0
votes
0answers
19 views

Threshold / Ratio to consider undersampling / oversampling

I have a classification task (predicting DNA methylation) with a somewhat unbalanced dataset - 38% of values are in the minority class, and the other 62% in the majority class. I have read that one ...
0
votes
0answers
71 views

under sampling a multi-label dataset

I have a multi-label dataset, whose label distribution looks something like this, with label on x-axis and number of rows it occurs in the dataset in y-axis. ...
0
votes
1answer
17 views

Should models built using under-sampled data be evaluated against the population

I have a dataset of 11 mil. rows with a 1:10 ratio between minority and majority classes. To train a model, I have selected all the minority class members and 1/3 of the majority class. The ratio is ...
0
votes
1answer
27 views

Coefficient estimates of logistic regression after downsampling majority class

I used a binary logit model with a lasso regularization term to predict an unbalanced dataset, where I used undersampling on the minority class (2% of observations) to get a 50/50 split of the classes....
0
votes
0answers
7 views

Best (quality/time) undersampling technique

I am working on a very unbilanced dataset (90% to 10%) with around 350.000 records, and am trying various classification methods. I bagan with SMOTE, which was quite fast, improved performance on tree ...
0
votes
1answer
72 views

Unbalanced dataset classification problem

I have a binary classification problem and I'm working with an unbalanced dataset. The count for each class in the training set looks like: ...
0
votes
1answer
42 views

What are some "not so common" methods for dealing with unbalanced data?

When we talk about unbalanced data, we usually think about SMOTE, resampling and so on. Usually the methods mentioned here: https://www.kaggle.com/rafjaa/resampling-strategies-for-imbalanced-datasets. ...
0
votes
0answers
568 views

What's a range of good F1 scores?

I have watched a lot of videos on machine learning and in terms of F1 scores, all are different. One video says that an F1 score of .8 is bad, but another says an F1 score of .4 is excellent. What's ...
0
votes
0answers
57 views

Limits of oversampling

I have a dataset with an event rate of less than 0.3 percent. To improve the modeling results, I did some oversampling using SMOTE. I initially oversampled so that the event rate increases 10 times to ...
0
votes
0answers
54 views

What causes the high OOB-error for randomForest() in R?

I'm trying to perform a random forest in R on a dataset with 16364 observations (after undersampling), using the function randomForest(). But my results look really weird: What could have caused this?...
1
vote
1answer
424 views

How R randomforest sampsize works?

I am working on a predictive model (imbalanced data) and trying to undersample the majority class data. I wanted to get the representative sample of my majority class and somehow came to know about R'...