Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [smote]

SMOTE stands for "Synthetic Minority Over-sampling Technique". It is a method to deal with imbalanced data.

0
votes
0answers
5 views

SMOTE and ROSE methods in CARET (R) do not work for balancing a multi-class dataset

SMOTE and ROSE methods in CARET (R) do not work for balancing a multi-class data set. Specifically, ROSE throws an error telling that it needs two levels. It means that it does not work for multi-...
3
votes
0answers
24 views

PCA, SMOTE and cross validation - how to combine them together?

I was reading a lot recently about PCA and cross validation and it seems that the majority call it malpractice to do PCA before cross validation. I would also like to perform SMOTE, but there is a ...
0
votes
1answer
34 views

Python / Keras: SMOTE and validation_split

I try to train a MLP with an imbalanced dataset. I'd like to use SMOTE to balance my classes; as highlighted here (https://beckernick.github.io/oversampling-modeling/), the class rebalancing should ...
0
votes
1answer
32 views

SMOTE - What is the difference in sampling before or inside train() [closed]

I have an unbalanced dataset and would like to apply SMOTE to the training data. I can either do one of the following: Inside trainControl() add ...
0
votes
1answer
113 views

Running XGBoost with *highly* imbalanced data returns near 0% true positive rate. Tried SMOTE and it did not improve much. What else can I do?

I'm using XGBoost on a dataset of ~2.8M records of hard drive failures, where less than 200 are tagged as failures. After cleaning, there are 11 features in this dataset. Below is my ...
0
votes
0answers
16 views

Can SMOTE Be Used for Pure Data Augmentation and not Just Imblanaced Classes

I have learned that SMOTE can be used to deal with imbalanced class datasets. Could it also be used to create a larger dataset, preserving the original structure/distribution and thus also the ...
0
votes
0answers
6 views

For ADASYN, if the neighbourhood of a minority sample contains no other minority sample, do I double the sample?

In ADASYN, for the last step in the paper linked below, if there exists no other minority class in the k-NN other than the one minority example, do we simply just double the training example? Because ...
0
votes
1answer
107 views

Reverse CARET proProcess()

I did the following steps in my modeling using R: 1)applied preProcess(data, method = c("bagImpute")) function in CARET package and then encoded the data. 2)Used SMOTE to balance the data(because the ...
0
votes
1answer
61 views

t-test or paired t-test to detect drift for suicide prediction

Context and data I am studying suicides among the military. I created a table that aggregates certain metrics (number of holidays, number of hours worked, etc...) for each officer, for each month ...
2
votes
1answer
41 views

Train on balanced datasets, used for imbalanced datasets?

We usually trained a model using balanced datasets. Even when we do not have a balanced datasets, we will use methods such as SMOTE to create a balanced dataset for training. The question is - how ...
0
votes
0answers
64 views

Oversampling using SMOTE leading to bad predictions on test set

I have a dataset with an imbalanced binary target. One class accounts for about 94 % of the target variable. I used SMOTE to oversample the minority class but after the oversampling step when I train ...
0
votes
0answers
20 views

Resampling imbalanced data in a multi-view scenario

Assume a multi-view scenario, where multiple views of the same entity are available. If each data pair is assigned a label and the resulting scenario is highly imbalanced, what are proper ways of ...
1
vote
1answer
19 views

Use of SMOTE with training, test and dev sets

I have a dataset with class imbalance about (1:10). I applied a SMOTE method by slitting the dataset into training and dev. I over sampled the training set using a SMOTE method and divided this set ...
1
vote
0answers
33 views

Bias-Variance Tradeoff when using Oversampling Technique

Oversampling techniques (e.g. SMOTE) are often used when target values are not approximately equally represented. How does this technique affect bias and variance of the predictive model that is ...
3
votes
1answer
571 views

SMOTE data balance - before or during Cross-Validation

I'm using Random Forest in the CARET package to tag a binary outcome with 1/10 ratio, thus I need to balance the dataset. I know two ways: Use SMOTE as a stand-alone function and then pass it to the ...
1
vote
0answers
543 views

Why does SMOTE over-sampling improve my accuracy? [closed]

I have an imbalanced dataset, for which I first split my data into train and test and then apply SMOTE on train data only. When I run the model on original test data (my test set is also imbalanced), ...
0
votes
0answers
98 views

SMOTE for binary features in R

I have a classification problem with 1330 observations and 139000 variables. All the variables are binary(0,1). The data is imbalanced with 97.8 % 0's and 2.2% 1's.I tried using SMOTE to balance that ...
1
vote
0answers
346 views

random forest imbalanced data-over, under, Smote Sampling

I am using random forest model for an imbalanced dataset. The dependent variable is Yes=73, No=7100. I have 65 independent variables both factor and numeric. I have tried to develop models for ...
0
votes
0answers
130 views

Applying SMOTE and increasing sensitivity

I am trying to analyze lending club data and want to predict whether a loan is risky or safe using random forest with decision tree as a classifier. The data is imbalanced. It contains one-fourth of ...
5
votes
1answer
8k views

ROSE and SMOTE oversampling methods

Can somebody give me a brief explanation of the differences between those two resampling methods : ROSE and SMOTE ?