Data organized into discrete categories or *classes* may present problems for certain analyses if the number of observations ($n$) belonging to each class is not constant across classes. Classes with unequal $n$ are *unbalanced*.

learn more… | top users | synonyms

0
votes
0answers
6 views

Setting effect weights to sum-to-zero in linear mixed effects model with unbalanced data

I am fitting a linear mixed effects model to longitudinal data. There is a between-Subjects factor Group with three levels (Info,...
1
vote
1answer
151 views

Finding the best dataset for classification

I have 100 datasets. All of them have varying number of features. There are around 20,000 samples in each of them. Every $i$-th sample in the 100 datasets has the same label ($0/1$). The data is ...
0
votes
0answers
14 views

Learning from Multiple Naive Annotator's Presence (and their labels as Y)

Although I am new to the forum, I have been following for several years and wanted to begin by sincerely thanking everyone, from the administrators to the members, for creating such an amazing ...
0
votes
0answers
40 views

Recursive feature elimination and class imbalance

I am trying to apply the recursive feature elimination in the R package caret following the example in the caret website: ...
1
vote
2answers
231 views

dealing with imbalanced data set in multiclass text classification

I need to build a text classification model. I have a labeled training set and my goal is to classify the new unlabeled text . My training set is composed on 6 categories, that are imbalanced. The ...
0
votes
0answers
14 views

What is the effect of class weight in Random Forest/Extra Trees Classifier variables importance?

In the sklearn implementation of random forest and extra trees classifier a class_weights parameter is available http://scikit-learn.org/stable/modules/generated/sklearn.ensemble.ExtraTreesClassifier....
0
votes
0answers
21 views

How to analyze differences between two time series collected under two different conditions

How should one analyze time series data that were collected during two seasons: season 1 and then at season 2, where during each season a measurement sample for several continuous variables were ...
0
votes
0answers
18 views

Learning with unbalanced classes

I have a biometric data set of size $n \sim 150,000$, with $p=21$ features $x_1,\dots,x_p$ representing information about people $-$ some categorical and some numerical. The original data set had only ...
0
votes
0answers
12 views

Literature (guidelines) on unbalancedness in two-way within-subject ANOVA

I am looking for literature (guidelines) which discuss the consequences of unbalanced designs on running a (two-way) within-subject ANOVA and pros/cons of various counter-measures. I came up with ...
0
votes
1answer
133 views

How to train classifier for unbalanced class distributions?

I attempted a ReLU neural network to classify data sets of 3 classes that are not balanced (in both training and test sets), i.e. 30% of samples are in class A, 10% in class B and 60% in class C. And ...
0
votes
0answers
7 views

Rebalancing doesn't give good results

We have a given a group of customers a price increase and as a result some have cancelled. We can identify exactly who they are because of the way they cancel. This means I can split them out from ...
0
votes
0answers
38 views

use “spml” for unbalanced panel data?

I wonder if I can use R's "spml" package for unbalanced panel data. Millo's paper and example are all based on balanced panel data. I try to apply it to an unbalanced panel data set, but got the ...
1
vote
1answer
55 views

Linear regression with unbalanced dummy variables + not normally distributed residuals

I am conducting a multiple linear regression analysis in SPSS. My DV is a score between 0 and 6, and my predictors are: one dichotomous nominal variable (native vs. non-native speakers) one ...
2
votes
0answers
19 views

How to set sum contrasts for unbalanced factors

Let's say that I have a model where the response time depends on accuracy (0/1, coded either as categorical or numerical) and another categorical variable (pres: idem/diff), both interacting with the ...
10
votes
2answers
2k views

The order of variables in ANOVA matters, doesn't it?

Am I correct to understand that the order in which variables are specified in a multifactorial ANOVA makes a difference but that the order does not matter when doing a multiple linear regression? So ...
0
votes
0answers
20 views

Unbalanced Repeated Measures Anova

First Question: I would like to double check that my code is doing what I think it is doing. I have two independent variables, Previous drilling and Soil Type, that are observational. Simpsons ...
1
vote
0answers
13 views

How to retrain a production classifier that blocks its own positive examples?

I'm looking for help understanding how to re-train a fraud detection classifier that's been deployed to production (where it successfully blocked much, but not all fraud coming into the system). I ...
0
votes
0answers
21 views

What to do with highly unequal sample sizes in a dummy linear regression? (+ nonnormal distribution)

I am conducting a multiple linear regression analysis in SPSS. My DV is continuous (score between 0 and 6), and my predictors are: one dichotomous nominal variable (native vs. non-native speakers) ...
0
votes
0answers
26 views

How to add hard negatives to original training data?

I have 2 class binary classification problem with original training data of size N=n_pos+n_neg in general case n_pos!=n_neg but now we can assume that number of positive and negative examples near the ...
0
votes
0answers
54 views

Caret classification: feature selection & unbalanced data

I have a two-class classification problem with very unbalanced data (~1:1000 Yes/No ratio). The initial model class I'd like to try is regular glm. So there are two issues need to be addressed: 1) ...
0
votes
0answers
16 views

What is the method to find difference in mean of test and control population where data were collected for a marketing campaign?

What is the method to find difference in the response rate of test and control populations in SAS where data were collected for a marketing campaign? (10-20% were control, and the rest were the test ...
0
votes
0answers
7 views

How to do posthoc comparisons for unbalanced 2-way ANOVA (type II SS)?

I am using the car package to perform a type II ANOVA on unbalanced data. My two factors are "storm size" and "storm frequency." I have two storm sizes and four storm frequencies. I only have both ...
0
votes
0answers
12 views

How to create stratified subsets of one file?

I have one large file with class imbalance problem. I would like to stratify the subset into 10 subsets, and to preserve the ration of class sizes for each fold. So for example the overall class ...
0
votes
1answer
20 views

Balancing classes for Neural Network training

In a speaker recognition problem I have 330 speakers (classes) as targets and want to predict the identities with a feedforward neural net with a softmax output layer. The thing is some classes have ...
3
votes
1answer
386 views

Training and testing on Unbalanced Data Set

My data has 13,000 rows, 7% belong to the minority class. I used SMOTE (Synthetic Minority Oversampling TEchnique) for class balancing such that I raised the ratio of minority class to 42 % and number ...
0
votes
0answers
23 views

Using priors, weights or costs for mitigating class imbalance?

A plethora of Matlab classifiers (e.g. tree-based or svm) allow to set priors, costs or weights for the data points. This can help dealing with imbalanced data. Unfortunately, none does support ...
1
vote
0answers
23 views

Tuning priors/weights/costs to counteract class imbalance

I have a classification problem which consists of two classes. It has high class imbalance. There are around 85% data points for the negative class and only 15% for the positive class. One option is ...
0
votes
0answers
11 views

Group treatment with unbalanced repeated measurments

In this study I want to determine if treatment group b and/or c are different from control group a. There are 13 individuals in the study. The groups are unbalanced as there is a different number of ...
0
votes
0answers
22 views

Is this a 2 fixed unbalanced ANOVA? How can be tested normality and homoscedasticity?

I need to know if my biological experiments show discrepancies between the condition used. In my experiments I have 2 fixed conditions: type of substrate (2 types) and chemical added (1 control + 3 ...
0
votes
0answers
13 views

Class imbalance and standard errors

I'm building a logistic regression that models the probability of conversion when clicking on a website ad. I'm not that interested in building a great classifier, but I want to identify a set of the ...
0
votes
1answer
40 views

When is dataset considered unbalanced?

I have data set which is highly unbalanced - target attribute is 93% False and 7% True. But I know that this is normal for my kind of data. I am afraid that if I undertake any steps (I can take less ...
2
votes
1answer
3k views

Which post-hoc is more valid for multiple comparison of an unbalanced lmer-model: lsm or mcp?

After doing a model comparison with my mixed lmer model, I have a model with three main effects, no interaction, say ...
3
votes
0answers
71 views

multiclass unbalanced data

I am trying to predict crimes (san francisco) using machine learning algorithms. Its a multi class classification problem with unbalanced data. I took sample of data ranging from years 2010 to 2015 ...
0
votes
1answer
30 views

Random Forests with modified partitioning criteria

Here is the context of my question : I'm doing binary classification with unbalanced classes. The measure of performance I'd like to maximise is a modified F-measure : $$ F_{\alpha} = \frac{1}{\frac{\...
6
votes
2answers
2k views

Testing Classification on Oversampled Imbalance Data

I am working on severely imbalanced data. In literature, several methods are used to re-balance the data using re-sampling (over- or under-sampling). Two good approaches are: SMOTE: Synthetic ...
3
votes
3answers
361 views

How can I derive confidence intervals from the confusion matrix for a classifier?

I have am using k-fold cross validation to generate a confusion matrix for a classifier. I need to calculate 95% confidence intervals for the number of times each class is predicted when run against a ...
1
vote
0answers
36 views

Unbalanced two-factor repeated measures ANOVA with missing values

For my data set, I need to perform some sort of two factor repeated measures ANOVA. I have one between-subject factor called "Treatment" and one within-subject factor called "Frequency" with 8 levels. ...
1
vote
1answer
79 views

High Recall - Low Precision for unbalanced dataset

I’m currently encountering some problems analysing a tweet dataset with support vector machines. The problem is that I have an unbalanced binary class training set (5:2); which is expected to be ...
1
vote
1answer
37 views

Model Decay of Random Forest, when does it require an update?

I have built a random forest model on a dataset with a large class imbalance, I have attempted to maximize area under the curve when predicting on the test set. I wish to make a suggestion on when the ...
0
votes
0answers
28 views

Unbalanced three-class classification problem

I have three classes which are pretty unbalanced: A, B, and C with 3343, 135 and 1219 observation each respectively. Classes A and C are linearly separable (with ~96% accuracy), while the class B ...
1
vote
0answers
30 views

How to handle with “in class” imbalance in machine learning?

A lot is written about class imbalance in machine learning (for example on this site here). However, how to deal with "intra class" imbalance? Assume I want to classify Bikes v.s. Cars. My training/...
0
votes
0answers
30 views

What techniques can I use to perform feature selection in the context of classification with an highly unbalanced dataset ?

I'm dealing with CTR prediction, which is a classification problem with an highly unbalanced dataset (around 1 positive class for 200 negative class). Most of my features (>90%) are categorical. ...
0
votes
0answers
107 views

Is gradient boosting appropriate for data with low event rates like 1%?

I am trying gradient boosting on a dataset with event rate about 1% using Enterprise miner, but it is failing to produce any output. My question is, since it a decision tree based approach, is it even ...
0
votes
1answer
164 views

Downsampling vs upsampling on the significance of the predictors in logistic regression

I've been trying to build a binary classification model using multivariate logistic regression using the caret package in R. My dataset consists of around 20000 observations from which >99% belongs to ...
2
votes
0answers
16 views

Interplay of Training Class Sizes, Class Weights, Loss function and Decision Threshold

I am facing a two-class classification problem where: There is way more training data in class 1 than in class 0. Classifying a class 0 event as class 1 has a higher loss than classifying a class 1 ...
2
votes
0answers
34 views

mixed effects modelling of unbalanced repeated measures data

I have radio tracking data on 34 animals over a period of up to 26 months. For about 6 animals I have all the data, for 2 others I only have a couple of months, and the rest lie somewhere in between. ...
0
votes
0answers
23 views

How implement sampling methods (for unbalanced data) in kfold cross-validaiton

Suppose that we have a unbalanced data-set for a binary classification problem and we want use 10-fold cross validation for training and testing fitted model. Is this correct that we only use ...
1
vote
0answers
70 views

Solve unbalanced data set problem in binary classification time series prediction (sampling methods)

I'm using time series data (continuous features) for binary time series prediction (one step ahead, up-turn and down-tern of output of t+1 comparing to ...
0
votes
1answer
39 views

output is a factor … how do I model it

If my input is numeric and my output is continuous I can use linear or nonlinear models. I can split the inputs by factors if an input is a factor. If my input is numeric and my output is boolean I ...