Data organized into discrete categories or *classes* may present problems for certain analyses if the number of observations ($n$) belonging to each class is not constant across classes. Classes with unequal $n$ are *unbalanced*.

learn more… | top users | synonyms

4
votes
0answers
661 views

Mixed-effects model for a strongly unbalanced design

I am somehow unsure on the best option to analyze these data. Here is my study case: The response variable is a morphometric measure, one for each individual. During 10 years, say 2000-2009, people ...
4
votes
0answers
410 views

Softmax regression bias and prior probabilities for unequal classes

I'm using Softmax regression for a multi-class classification problem. I don't have equal prior probabilities for each of the classes. I know from Logistic Regression (softmax regression with 2 ...
3
votes
0answers
45 views

multiclass unbalanced data

I am trying to predict crimes (san francisco) using machine learning algorithms. Its a multi class classification problem with unbalanced data. I took sample of data ranging from years 2010 to 2015 ...
3
votes
0answers
58 views

Precision in unbalanced multi-class problem

I am dealing with a multi-class classification problem and I compute micro-averaged evaluation metrics (precision, recall and F-measure) by performing 10-fold cross validation. However, the fact that ...
3
votes
0answers
257 views

Mixed ANOVA: small and unbalanced samples

I have to analyze two samples ($n_1=10, n_2=18$) in a design in which there is a between-subject factor (Groups: 2 levels) and a within-subjects factor (...
3
votes
0answers
593 views

Problem with classifier after using SMOTE to balance the data

We've ran into a problem while training a classifier on an unbalanced data set. The response is binary with 0 indicating 'non defaulter' and 1 indicating 'defaulter' (it's a credit scoring task). ...
3
votes
0answers
473 views

How to use k nearest neighbours for binary classification with unbalanced classes?

I have relatively large (100k items) dataset which I need to split in two groups. So far I've tried knn and the results are not good mainly because I have disproportion in my training data: 90% of ...
2
votes
0answers
13 views

Interplay of Training Class Sizes, Class Weights, Loss function and Decision Threshold

I am facing a two-class classification problem where: There is way more training data in class 1 than in class 0. Classifying a class 0 event as class 1 has a higher loss than classifying a class 1 ...
2
votes
0answers
21 views

mixed effects modelling of unbalanced repeated measures data

I have radio tracking data on 34 animals over a period of up to 26 months. For about 6 animals I have all the data, for 2 others I only have a couple of months, and the rest lie somewhere in between. ...
2
votes
0answers
124 views

Is using Rpart with unbalanced data a good idea?

I have a rather unbalanced data set and want to use rpart to build a classification tree. After building the full tree, I prune it back using the 1-SE rule. On average, only 1-2 splits are suggested. ...
2
votes
0answers
48 views

Unbalanced groups and classification errors

I would like to adopt a general strategy for dealing with an very unbalanced dataset, where my "positive" group corresponds to 1/40 of all the observations. The reason why I ask it is because all the ...
2
votes
0answers
402 views

Average of predicted values with logistic regression

I have a large unbalanced dataset (the target has ~1500x more 0's than 1's) on which I train a logistic regression algorithm to predict the probability of success (Not a binary outcome but a real ...
2
votes
0answers
249 views

Unbalanced panel data: Fixed effects?

I have an unbalanced panel dataset with N=10 firms and T=61 days. Because one variable had values outside the theoretical range I had to constrain my dataset, which left me with only 239 observations. ...
2
votes
0answers
482 views

Repeated measures ANOVA for an experiment with missing values

I have an experiment where several subjects (subjects $= S_1,S_2,...,S_m $) were asked to perform a set of tasks (tasks $= T_1, T_2, T_3,...,T_n$) using both their left ($L$) and right ($R$) arms. ...
2
votes
0answers
667 views

How to analyze an unbalanced within-subject ANOVA design?

I have data from an experiment involving 4 groups of subjects, 2 possible interventions first and 3 possible intervention at a 2nd point, repeated data measurements from each subjects multiple time ...
1
vote
0answers
21 views

Tuning priors/weights/costs to counteract class imbalance

I have a classification problem which consists of two classes. It has high class imbalance. There are around 85% data points for the negative class and only 15% for the positive class. One option is ...
1
vote
0answers
19 views

Unbalanced two-factor repeated measures ANOVA with missing values

For my data set, I need to perform some sort of two factor repeated measures ANOVA. I have one between-subject factor called "Treatment" and one within-subject factor called "Frequency" with 8 levels. ...
1
vote
0answers
24 views

How to handle with “in class” imbalance in machine learning?

A lot is written about class imbalance in machine learning (for example on this site here). However, how to deal with "intra class" imbalance? Assume I want to classify Bikes v.s. Cars. My ...
1
vote
0answers
48 views

Solve unbalanced data set problem in binary classification time series prediction (sampling methods)

I'm using time series data (continuous features) for binary time series prediction (one step ahead, up-turn and down-tern of output of t+1 comparing to ...
1
vote
0answers
43 views

What post hoc test should I run for a significant interaction in a two-way unbalanced ANOVA?

I have data with two factors (Category and Treatment) and each factor has two levels (A and ...
1
vote
0answers
20 views

Chi-squared test of independence for biased data

I'm working with a survey dataset consisting of 28807 observations (8470 males and 20337 females). I'm trying to determine the association between dichotomous variables, for instance, sex (Male, ...
1
vote
0answers
39 views

Class imbalance problem and baseline classifier

I have a dataset with four numerical attributes and a class (target) variable. There is an enormous imbalance between positive and negative instances according to class variable. To cope with ...
1
vote
0answers
60 views

For classification w unbalanced datasets, is class-weighing the same as oversampling?

in unbalanced classification problems, I find myself using class_weigh = "auto" or similar parameters often, but I don't think I'm fully understanding what it's doing. I know that it's the industry ...
1
vote
0answers
24 views

Should the number of normal samples always be more than that of anomalous samples in training set for anomaly detection?

I am trying to train an anomaly detection algorithm (one-class svm) on a data set with a few hundred positive samples and several thousands negative examples. Is it mandatory that I train the model ...
1
vote
0answers
122 views

Non-parametric Levene's test by Nordstokke and Zumbo

The example they mention is using a one-way ANOVA. What if I have two factors (3x11) and a dependent variable, can I do a two-way ANOVA to calculate the univariate levene's test? If so, how would I ...
1
vote
0answers
79 views

positive and negative sample count for ConvNets

I have been trying to set up a ConvNet to classify some data. This data should be classified to either 1 (being what I need to get from the image) and 0 for everything that is irrelevant. I have ...
1
vote
0answers
22 views

Multiclass target detection : N X (1 vs all) or 1 X (N vs all) ?

I am doing a multiclass classification using neural networks. say I have 10 target classes and one null (non-of-the-above-targets). is it better that I train a neural network separately for each ...
1
vote
0answers
55 views

Achieving high recall for smaller class in unbalanced linear svm

I have an svm-related question. I have an unbalanced dataset, meaning classA could be 1/10 to 1/35 of classB. Well I am interested in getting a linear svm which would separate the data and would ...
1
vote
0answers
166 views

How to do a power analysis for an unbalanced mixed effects ANOVA?

I need suggestions for how to calculate the $n$ required for 80% and 90% power for >30% change from baseline ($T_0$) at $T_1$ or $T_2$, drug vs. placebo, 2:1 ratio; 20% CV in test; factors: subject, ...
1
vote
0answers
47 views

Is it correct to compare two distributions of observed (that are means of observation) and expected values with chi square?

I have 2 classification methods that I want to compare. So I ran them on the same dataset and I obtained 2 different classifications. Then, I want to test if their classification is robust and how. ...
1
vote
0answers
102 views

Testing classifier with binomial test when group sizes are unequal

I have data from 50 human subjects, who are divided into groups A and B (30 participants are in group A and 20 participants in group B). I also have a range of measurements from each subject. I have ...
1
vote
0answers
321 views

Questionnaire analysis and grouping responses

I want to know if the creative process engagement (CPE) is related to creativity. I don't know how to analyze the questionnaire. I will be collecting data for CPE with Zhang and Bartal's (2010) ...
1
vote
0answers
92 views

Type I ANOVA tests not depending on the order of the factors

I have a dataset with two factors A and B and the following design (contigency table showing the number of individuals for each ...
1
vote
0answers
121 views

Different Mean Square partitions in an unbalanced bifactorial ANOVA (with random factor) between R and Statistica

I am trying to extract variance components for selection and chance in a bifactorial design with Generation as a fixed factor and Replicate as a random term, for early fecundity. Since I am using ...
1
vote
0answers
230 views

How to compare multiple groups of unblanced repeated measures non normal data?

I'm trying to compare three groups data. But the data set is about a new drug trial. The data set has these characteristics: Follow-up set. That is, after administration of the drug, a series of ...
0
votes
0answers
5 views

How to do posthoc comparisons for unbalanced 2-way ANOVA (type II SS)?

I am using the car package to perform a type II ANOVA on unbalanced data. My two factors are "storm size" and "storm frequency." I have two storm sizes and four storm frequencies. I only have both ...
0
votes
0answers
11 views

How to create stratified subsets of one file?

I have one large file with class imbalance problem. I would like to stratify the subset into 10 subsets, and to preserve the ration of class sizes for each fold. So for example the overall class ...
0
votes
0answers
8 views

Using priors, weights or costs for mitigating class imbalance?

A plethora of Matlab classifiers (e.g. tree-based or svm) allow to set priors, costs or weights for the data points. This can help dealing with imbalanced data. Unfortunately, none does support ...
0
votes
0answers
10 views

Group treatment with unbalanced repeated measurments

In this study I want to determine if treatment group b and/or c are different from control group a. There are 13 individuals in the study. The groups are unbalanced as there is a different number of ...
0
votes
0answers
19 views

Is this a 2 fixed unbalanced ANOVA? How can be tested normality and homoscedasticity?

I need to know if my biological experiments show discrepancies between the condition used. In my experiments I have 2 fixed conditions: type of substrate (2 types) and chemical added (1 control + 3 ...
0
votes
0answers
10 views

Class imbalance and standard errors

I'm building a logistic regression that models the probability of conversion when clicking on a website ad. I'm not that interested in building a great classifier, but I want to identify a set of the ...
0
votes
0answers
20 views

Unbalanced three-class classification problem

I have three classes which are pretty unbalanced: A, B, and C with 3343, 135 and 1219 observation each respectively. Classes A and C are linearly separable (with ~96% accuracy), while the class B ...
0
votes
0answers
23 views

What techniques can I use to perform feature selection in the context of classification with an highly unbalanced dataset ?

I'm dealing with CTR prediction, which is a classification problem with an highly unbalanced dataset (around 1 positive class for 200 negative class). Most of my features (>90%) are categorical. ...
0
votes
0answers
50 views

Is gradient boosting appropriate for data with low event rates like 1%?

I am trying gradient boosting on a dataset with event rate about 1% using Enterprise miner, but it is failing to produce any output. My question is, since it a decision tree based approach, is it even ...
0
votes
0answers
18 views

How implement sampling methods (for unbalanced data) in kfold cross-validaiton

Suppose that we have a unbalanced data-set for a binary classification problem and we want use 10-fold cross validation for training and testing fitted model. Is this correct that we only use ...
0
votes
0answers
24 views

use “spml” for unbalanced panel data?

I wonder if I can use R's "spml" package for unbalanced panel data. Millo's paper and example are all based on balanced panel data. I try to apply it to an unbalanced panel data set, but got the ...
0
votes
0answers
35 views

SMOTE algorithm how to select over and under percentage?

I have a highly unbalanced binary dependent variable (i.e. cases of '1' is <5%). I am trying to implement SMOTE algorithm using R DMwR package. I wonder in general, how we determine the parameters ...
0
votes
0answers
27 views

handle unbalanced data in multi-class

I have three classes A,B,C. They are different in their feature values. Another class D is the one I want to distinguish from A,B,C. From my perspective, I can treat A,B,C as one class (let's call it ...
0
votes
0answers
24 views

Minimize coefficient bias in regression with effects coded categorical variables where data is unbalanced and missing

I have a data set with two categorical variables that are effects coded. 6 out of 18 observations do not have records for the first categorical variable. 12 out of 18 observations do not have records ...
0
votes
0answers
46 views

What loss function should one use to get a high precision or high recall binary classifier?

I'm trying to make a detector of objects that occur very rarely (in images), planning to use a CNN binary classifier applied in a sliding/resized window. I've constructed balanced 1:1 ...