Questions tagged [oversampling]

Sampling cases with differential probability, so that classes that occur rarely in the population occur more often in the training data. Does *not* address the problems in unbalanced classes.

Filter by
Sorted by
Tagged with
1
vote
1answer
19 views

Getting different results when running SMOTE

I have this code which runs SMOTE and then getting roc_auc_score. The issue is that every I run the code on the same dataset, I get different results. How can I fix this? I need the same sample when ...
0
votes
1answer
26 views

Callibration after oversampling

We have build a credit scoring model with OptBinning library in python. In the process we oversampled the minority class and now we want to callibrate it back to ...
0
votes
0answers
22 views

Random sampling and over sampling

I have binary $\{0,1\}$ classification data that I will use for statistical analysis. The data provider said that the data are randomly drawn from the population and at the same time he said samples ...
0
votes
0answers
16 views

What should be the class imbalance ratio?

I'm working with a really imbalanced binary classification dataset so I decided to use SMOTE for only on the train data. Class rates were 95% -5% before SMOTE and 75-25% after SMOTE. In other words, I ...
0
votes
0answers
29 views

Is balancing class data for imbalanced problems helpful or just folklore when considering thresholds?

(In the context of predictive models) Caveat: I'm aware that imbalanced data questions are a dead horse, but I haven't found an answer to this flavor of it directly. When working with highly ...
2
votes
0answers
42 views

How to determine the correct amount of oversampling (in regression)

For my regression problem I splitted my dataset into a stratified train- and testset (70:30) and I now want to train my models (random forest, gbm, logistic regression) using the trainset. The dataset ...
0
votes
0answers
24 views

Can I inverse the standardscaler after using SMOTE?

As it is written here, you should standardize the data before applying SMOTE. If I inverse the standardscaler action with inverse_transform after using SMOTE, will ...
0
votes
0answers
31 views

Is upsampling a tiny class before cross-validation valid?

I'm working with a dataset containing several classes. The largest class has over 500 samples, and the smallest classes have fewer than 10 samples. I know that you should perform upsampling inside the ...
0
votes
0answers
37 views

How to tune an weighted voting ensemble method?

I am working on kidney cancer patients' data with 5 unbalanced labels. These codes are contained of Normalization, Oversampling on Feature Engineering part. A list of 9 ordinary Machine Learning ...
0
votes
0answers
41 views

Does oversampling or undersampling not impact the coefficients of independent variables?

I have come across a few discussions on this site which state that random oversampling or undersampling doesn't impact the coefficients of the independent variables in logistic regression. Since the ...
0
votes
1answer
44 views

Training with oversampling

I'm building a Random Forest model over an unbalaced 4 class dataset. So far I understood how to use oversampling and train my model. My doubt was about when to perform Oversampling. I've already seen ...
0
votes
0answers
173 views

How H2O perform class balancing?

I wanto to perform class balancing using h2o autoML. I know there is a parameter class_sampling_factors that allow to specify the under/over sampling factor for ...
0
votes
0answers
38 views

Limits of oversampling

I have a dataset with an event rate of less than 0.3 percent. To improve the modeling results, I did some oversampling using SMOTE. I initially oversampled so that the event rate increases 10 times to ...
0
votes
0answers
24 views

How to oversample multivariate time series (sensor failure data)?

Let's say that I have a multivariate time series dataframe of sensors. Each sensor has its serial number, group, several statistics and column failure. Data about sensor's statistics are collected ...
1
vote
0answers
54 views

Will oversampling help with generalization (small imbalanced dataset)?

I have an imbalanced dataset (2:1 ratio) with about 60 patients and 80 features. I performed RFE + stratified cross validation to reduce the features to 15 and I get an AUC of 0.9 with Logistic ...
0
votes
0answers
68 views

Classification on rare events (~%3) and only categorical variables

I need to build a model based on about 10 independent variables, all categorical (only two of which are potentially ordinal), to predict a dichotomous output ('1': 3%; '0': 97%). To overcome the ...
1
vote
0answers
107 views

When is oversampling preferable to undersampling and vice versa?

When data is unbalanced, that is, when the distribution of classes being predicted is very uneven (e.g. 90%/10% for two classes or 10%/15%/75% for three classes), many machine learning models have ...
0
votes
2answers
507 views

SMOTE in unbalanced dataset with binary features

after reading different posts about unbalanced datasets I didn't make my mind clear about my specific problem so that's why I'm posting a new question. In my case, I have a dataset with around 20K ...
2
votes
1answer
867 views

Oversampling methods for numerical data (regression)

There are many oversampling methods for categorical labels (for example SMOTE and Rose, etc.). But, are there oversampling method for numerical labels (the thing that I want to predict with my ...
0
votes
0answers
130 views

Is doing oversampling on train set and undersampling on test set correct?

I have an imbalanced dataset (95% in class 0 and 5% in class 1) and I am using machine learning for classification. The AUC(Area under ROC curve) was high (about 0.86) but AUPRC(Area under precision-...
2
votes
3answers
3k views

Does oversampling/undersampling change the distribution of the data?

I have an imbalanced dataset (10000 positives and 300 negatives) and have divided this into train and test sets. I perform oversampling/undersampling only on the train set since doing this on the test ...
1
vote
1answer
53 views

How do i re-train a final model after using oversampling?

I am a bit puzzled about the process of experimenting with a model and oversampling and then translating it to the final version of the model that will be used: I oversample the data (only the ...
1
vote
0answers
97 views

SMOTE and Lagged Observations

I'm doing a project about the effect of synthetic oversampling in a machine learning context (more precise SMOTE for the oversampling of the minority class of a highly imbalanced target variable). The ...
1
vote
2answers
1k views

Oversampling a multi-labeled data set

Given a data set where each individual data point can be assigned to more than 1 class (a multi-class, multi-label data set), are there any guidelines for calculating oversampling weights, i.e., the ...
1
vote
3answers
1k views

Binary Classification in Imbalanced Data; Oversampling and Imputation

Together with two friends I participate in a university course about data mining in R and we chose the topic of bankruptcy prediction. We started with some "clean" data found on an "In class" kaggle ...
3
votes
2answers
343 views

Run time of SMOTE function in package DMwR

I have a dataframe with 930 000 rows and 220 variables. The objective is a binary classification but my response classes are imbalanced. (88% - 12%) I want to use SMOTE to artificially create ...
2
votes
1answer
56 views

Running SMOTE on unbalanced data

I've read a few answers to similar questions that advise the completion of SMOTE after splitting the data set into Train and Test sets however, the documentation and other examples I've seen run SMOTE ...
1
vote
1answer
632 views

Effects of Oversampling on Linear Regression

We often see that oversampling is a useful technique to combat skewed classes. But there is not much discussion about linear regression. If we just duplicate the original data, and train the linear ...
1
vote
0answers
125 views

influence of oversampling on Semi-supervised multi-label learning

I have suggested a semi-supervised approach for the hierarchical multi-label classification task. I have included the MLSMOTE oversampling technique as a pre-processing step, and then evaluate the ...
2
votes
0answers
737 views

Logistic Regression Class Imbalance and the use of weighting and undersampling

I have been working on a machine learning model using Spark (binomial) LogisticRegression. The dataset has what I think is a high degree of imbalance - roughly 1% of rows are labelled as events. The ...
1
vote
1answer
183 views

Adjusting precision recall curve for oversampling

I built a model for a binary target using oversampled data. The population target prevalence is 0.25. I oversampled to 0.5 by keeping the entirety of the minority class and sampling a portion of the ...
3
votes
3answers
10k views

Running XGBoost with *highly* imbalanced data returns near 0% true positive rate. Tried SMOTE and it did not improve much. What else can I do?

I'm using XGBoost on a dataset of ~2.8M records of hard drive failures, where less than 200 are tagged as failures. After cleaning, there are 11 features in this dataset. Below is my ...
1
vote
0answers
11 views

Oversampling to Create Correlated Feature from Existing Feature

For demo purposes in Python, I would like to create an array or pandas df column that shares a high degree of correlation with an existing array. This is not as easy as it sounds and I don't think it ...
0
votes
0answers
73 views

Imbalanced class SVM prediction results using different validation data

I am trying to fit my data to a classifier using SVM. My data has 2 classes, the positive class which occurs with a probability of 0.002 and the negative class which is the dominant one. Suppose that ...
1
vote
0answers
135 views

While dealing with imbalanced classes, to what extent can we upsample a minority class? [duplicate]

I have my training data with the following approximate distribution: Negative events : 90,000 positive events : 5,000 Training a model would require to oversample the minority class (and might also ...
1
vote
0answers
415 views

Oversampling using SMOTE leading to bad predictions on test set

I have a dataset with an imbalanced binary target. One class accounts for about 94 % of the target variable. I used SMOTE to oversample the minority class but after the oversampling step when I train ...
7
votes
1answer
6k views

Normalization/standardization: Should one do this before oversampling/undersampling the data or after?

When working with imbalanced datasets, should one do one-hot encoding and data standardization before or after sampling techniques (such as oversampling or undersampling)?
3
votes
1answer
2k views

How to report the results of a cross-validation to a paper: Can I manually select the best results?

Good morning. With regard to the interpretation of the results of the N-fold cross-validation with over-sampling (SMOTE), I raise the question to write up the paper. Currently, I have performed 5-...
0
votes
1answer
398 views

Oversampling problems in prediction

I have a dataset that contains 284315 samples of class 0 and 492 of class 1. I know, that's huge. I heard about oversampling methods, so I did the following using the RandomOverSampler library: ...
39
votes
0answers
1k views

Are unbalanced datasets problematic, and (how) does oversampling (purport to) help? [duplicate]

TL;DR See title. Motivation I am hoping for a canonical answer along the lines of "(1) No, (2) Not applicable, because (1)", which we can use to close many wrong questions about unbalanced datasets ...
1
vote
1answer
365 views

Random Over Sampling to handle Data Imbalance

Was reading an article on imbalanced datasets where the event occurs and look at balancing the dataset. In that article, the event records were 2% of the total records. The author of the blog ...
1
vote
0answers
118 views

Bias-Variance Tradeoff when using Oversampling Technique

Oversampling techniques (e.g. SMOTE) are often used when target values are not approximately equally represented. How does this technique affect bias and variance of the predictive model that is ...
9
votes
1answer
3k views

Oversampling: whole set or training set

I have a rather small dataset of 4 000 points (140 features) to feed to a NN binary classifier. The problem is only ~700 of them represent the second class. Is it more common to resample the whole ...
1
vote
0answers
598 views

random forest imbalanced data-over, under, Smote Sampling

I am using random forest model for an imbalanced dataset. The dependent variable is Yes=73, No=7100. I have 65 independent variables both factor and numeric. I have tried to develop models for ...
3
votes
2answers
87 views

Using patient characteristics to predict disease and confront with per hospital real cases

We have a large, nationwide prevalence study about the prevalence of healthcare-associated infections (HAI). We need to see if hospitals have more or less HAI than expected by their patients' ...
0
votes
1answer
304 views

Modeling Attrition: Imbalanced Training

First of all, let me say I am new to Machine Learning and am eager for any sort of feedback. I am attempting to create a predictive attrition model, and my training and test data each have ~ 17% ...
0
votes
1answer
194 views

oversampling in nested cross validation

Introduction I have a small mixed dataset consisting of continuous and categorical independent variables with a dichotomous dependant variable. I'm running various algorithms (neural networks, random ...
6
votes
1answer
505 views

During oversampling of rare events, why are the beta coefficients of the independent variables not affected, but only the intercept?

I have followed the King and Zeng paper and understand the consistency of the prior correction after oversampling in logistic regression. But I am trying to understand why the beta coefficients of the ...
1
vote
0answers
58 views

The problem between over-sampled, down-sampled data and original data using SVM with unbalanced data

I am working on a classifier that is supposed to do binary classification on a dataset includes 5996 examples. ~800 of this examples belongs to class 1 and the rest is class 0. Since there is a huge ...
0
votes
1answer
101 views

How to interpret results of a predictive model when an external factors leads to imbalanced target labels

I have a prediction task, in which I use DecisionTreeRegressor of scikit-learn to predict a target label, which is about a certain user behaviour in a web platform (...