Data organized into discrete categories or *classes* may present problems for certain analyses if the number of observations ($n$) belonging to each class is not constant across classes. Classes with unequal $n$ are *unbalanced*.

learn more… | top users | synonyms

1
vote
2answers
64 views

Which classifiers work well with unbalanced data?

I have a binary classification problem which is very unbalanced - it can have 98% of data from one class. Which classifiers work well with this sort of data? I have an unlimited supply of training ...
0
votes
0answers
8 views

Achieving high recall for smaller class in unbalanced linear svm

I have an svm-related question. I have an unbalanced dataset, meaning classA could be 1/10 to 1/35 of classB. Well I am interested in getting a linear svm which would separate the data and would ...
1
vote
0answers
22 views

How to do a power analysis for an unbalanced mixed effects ANOVA?

I need suggestions for how to calculate the $n$ required for 80% and 90% power for >30% change from baseline ($T_0$) at $T_1$ or $T_2$, drug vs. placebo, 2:1 ratio; 20% CV in test; factors: subject, ...
0
votes
1answer
20 views

How to deal with a skewed class in binary classification having many features?

I am doing data analysis in the mobile ad targeting domain. I have around 18 features and for a combination of these features, the result is either True or False (1/0) depending on whether the ...
0
votes
1answer
27 views

Unbalanced test data matter?

I have balanced training data: 300 positives and 300 negatives, but the test data is unbalanced: I have 15 positives and 60 negatives. Will the unbalanced test data impact classification accuracy? ...
0
votes
0answers
33 views

Training and testing on Unbalanced Data Set

I used SMOTE algorithm in R for class balancing. My data size has 13000 rows, I had 7% minority class in my sample now I used SMOTE( Synthetic Minority Oversampling Technique) for class balancing such ...
1
vote
1answer
83 views

Logistic sample and case numbers

I have some questions about binary logistic regression. For my research, I am planning to use 12 predictors, and my sample consists of 129 cases. However, I know of a 1 to 10 rule. Additionally, my ...
1
vote
2answers
113 views

How to deal with unbalanced data

I'm doing data analysis with a dataset of 11795 data points (with 88 features). 85% (9973 points) of these data points correspond to data points belonging to class 1, 5% (589 points) belong to class 2 ...
0
votes
0answers
16 views

Is it correct to compare two distributions of observed (that are means of observation) and expected values with chi square?

I have 2 classification methods that I want to compare. So I ran them on the same dataset and I obtained 2 different classifications. Then, I want to test if their classification is robust and how. ...
0
votes
0answers
11 views

Oversampling with categorical variables

I would like to perform a combination of oversampling and undersampling in order to balance my dataset with roughly 4000 customers divided into two groups, where one of the groups have a proportion of ...
0
votes
0answers
16 views

the effect of unbalanced classes

I have a data set with label "Y" and "N", which is splitted into training and testing sets. The ratio the labels in training and testing sets are 3:1 and 1:1, respectively. If I build model using the ...
0
votes
1answer
63 views

Improving SVM classification

I have a classification problem (bioinformatics domain) where I have around 333 features. Currently, I am first selecting features (using importance feature of random forest) and then pushing the same ...
0
votes
0answers
23 views

How to account for multiple & varying amounts of observations per factor level & still retain info? As a random effect in GLMM or take the mean?

I would appreciate any help! Specifically I would like to know which option is best. Question Does Var2 influence Var1 in relation to the factor(Ind), and does Var3 & Var4 also have some effect. ...
0
votes
0answers
15 views

How to handle imbalanced data using SMOTE-N (nominal data) to generate multiple synthetic data?

I have a classification problem with two classes working on nominal data. I want to apply SMOTE-N to deal with imbalanced data. However, it is not clear to me how to use SMOTE-N for generating N ...
0
votes
0answers
120 views

One-way ANOVA with unequal sample sizes

I have a function for performing one-way ANOVA in R: ...
1
vote
1answer
53 views

Is f-measure synonymous with accuracy?

I understand that f-measure (based on precision and recall) is an estimate of how accurate a classifier is. Also, f-measure is favored over accuracy when we have an unbalanced dataset. I have a simple ...
1
vote
0answers
37 views

Testing classifier with binomial test when group sizes are unequal

I have data from 50 human subjects, who are divided into groups A and B (30 participants are in group A and 20 participants in group B). I also have a range of measurements from each subject. I have ...
0
votes
0answers
19 views

Comparing networks of groups of unequal size

I want to compare some network properties such as entropy, connectivity, etc., between 2 groups. I have time series fMRI data on patients (n = 80) and controls (n = 30) for certain regions of the ...
2
votes
2answers
76 views

Suggestions for cost-sensitive learning in a highly imbalanced setting

I have a dataset with a few million rows and ~100 columns. I would like to detect about 1% of the examples in the dataset, which belong to a common class. I have a minimum precision constraint, but ...
0
votes
2answers
86 views

Handling unbalanced data using SMOTE - NO BIG DIFFERENCE?

I have a classification problem with 2 classes. I have nearly 5000 samples, each of which is represented as vector with 570 features. The positive class samples are nearly 600. Meaning, I have a 1:8 ...
0
votes
0answers
40 views

Repeated Measures ANOVA or mixed model? And with massive group differences?

I need some guidance on which statistical test to use: I want to know if the nature of frog calls changes depending on the time of day. I observed 4 species of frogs at the same 3 times for several ...
0
votes
2answers
68 views

Determine if difference in class distribution is statistically significant

I have a dataset of some observations with class attribute of values 0 and 1. The dataset is quite unbalanced (class 1 – 15%, class 0 – 85%). Further this dataset consists of 5 years, and the ...
2
votes
1answer
110 views

Which metric should I trust to evaluate my predictive model

I am working on predictive model and when I evaluate it, I find good accuracy_score, precision_score, ...
0
votes
0answers
27 views

Trial with two sites, two years - Different number blocks - Problem? (Q1)

I have got two questions on an agricultural field trial that was conducted at two sites in two conscutive years. Virtually everything was the same in all trials (crop variety, planting density...). ...
1
vote
3answers
100 views

SVM for unbalanced data

I want to attempt to use Support Vector Machines (SVMs) on my dataset. Before I attempt the problem though, I was warned that SVMs dont perform well on extremely unbalanced data. In my case, I can ...
2
votes
2answers
42 views

Collecting training data for document classification with unbalanced classes

I have a document classification problem in which the estimated class proportions in the population are severely unbalanced: the population is ~99% class 0 and ~1% class 1. I am using a logistic ...
0
votes
0answers
33 views

How do I partition variance among nested random effects for non-normal data and an unbalanced design?

I have a dataset of plant drought tolerance values (called TLP_DRY) that I would like to partition variance for among the nested levels Biome/Study site/Species to figure out whether most variation in ...
0
votes
1answer
82 views

Should I specify Prior or Cost matrix with Tree Bagger in Matlab

I'm trying to create Random Forests in Matlab and there are more observations in some classes than there are in others. Do I need to specify this as a cost matrix or as a prior probability or will ...
3
votes
1answer
102 views

Using Wilcoxon-Mann-Whitney test for comparing two population of different sizes

I am using Wilcoxon-Mann-Whitney test for comparing two populations. Unfortunately, sizes of my population are different; one has size 100000 and the other 6000. Can I use this test to compare these ...
2
votes
1answer
109 views

unbalanced samples random Forests

I am trying to predict species presence or absence using randomForest in R (classification). In fact, I am trying to do it for several species, in separate models. For a couple of the species, the ...
0
votes
2answers
201 views

Correlation and group difference with unequal sample sizes

My sample is 60 participants. At first, I did not expect to analyze the correlation, but the result is interesting, so I would like to. The 60 participants are 50 people who have good reading skill ...
3
votes
1answer
60 views

Cross Validation in Unbalanced Datasets

Is there a specific way of sampling which maintains the ratio of samples in an unbiased set? e.g., lets say I want to do k-fold cross-validation on my training set And my training set is very ...
0
votes
0answers
154 views

How to set parameters for SMOTE in WEKA?

How I can choose the most optimal parameters for SMOTE in WEKA. More specifically, how should I pick the nearest-neighbours and the SMOTE to apply? I have been using the amount of SMOTE that gives the ...
3
votes
2answers
705 views

Calculating statistical significance with unequal sample sizes and unequal variances

I have two samples, one with $n_1 = 41,000$ and the other with $n_2 = 881$; the larger sample has a standard deviation of $13.74$, and the smaller has an $SD=10.75$. The means are different, and when ...
1
vote
0answers
69 views

Questionnaire analysis and grouping responses

I want to know if the creative process engagement (CPE) is related to creativity. I don't know how to analyze the questionnaire. I will be collecting data for CPE with Zhang and Bartal's (2010) ...
2
votes
1answer
140 views

How to analyze unequal samples in linear and multiple regression

I have three variables (sample size is mentioned below), and I want to analyze data using regression models as recommended by Judd and Kenny (1981) to see if $cc$ mediates the relationship between ...
3
votes
0answers
159 views

Mixed ANOVA: small and unbalanced samples

I have to analyze two samples ($n_1=10, n_2=18$) in a design in which there is a between-subject factor (Groups: 2 levels) and a within-subjects factor (...
7
votes
2answers
369 views

Does a big difference in sample sizes matter for an independent t-test?

There is a very confusing question in my mind. I have data, and would like to compare numeric scores between men and women. There is a big difference in those two groups: the number of men is 34, ...
0
votes
0answers
49 views

How do you analyse an unbalanced dataset using dummy variables?

I have a returns (finance) dataset with 3 factors, each with 3 levels: industry (banking, retail, others), year (2010, 2011, 2012), and size (small, medium, large). Each factor has been coded as a ...
0
votes
0answers
98 views

Interpreting coefficients for random effects models with extremely unbalanced data

I'm currently working with a data set that has numerous samples collected over time at different sites in a study area, and I'm interested in detecting a trend over time for that area. I know that in ...
3
votes
1answer
52 views

What test of significance should I use to analyse visits to a clinic by various groups?

Apologies for the noob question. After a day on Google and Wikipedia I still can't quite work out what to do. So here I am. A small private healthcare clinic in the UK has asked me to look at their ...
0
votes
2answers
67 views

Choosing the best featureset for prediction

I have this N sets of features F each with $F_i$ number of features. All the feature sets have 20000 examples and we have 20,000 labels for them. Lets say feature set $F_1$ has 10 features and ...
1
vote
1answer
64 views

Finding the best dataset for classification

I have 100 datasets. All of them have varying number of features. There are around 20,000 samples in each of them. Every $i$-th sample in the 100 datasets has the same label ($0/1$). The data is ...
0
votes
2answers
140 views

How similar are my 2 data sets?

I am kind of stuck with an easy question: I have two data sets with experimental data. The data sets do not have the same size. I would like to show that these data sets are possibly coming from the ...
0
votes
0answers
27 views

Impact of biased sampling on classifier training ?

Let's imagine I have a very unbalanced dataset with 99.99% of 0 and 0.01% of 1 on the target variable. What I want to do is make a classifier for this target. Now imagine that this dataset is very ...
5
votes
2answers
204 views

Classification problem using imbalanced dataset

I am working on a pattern identification/classification problem on an imbalanced dataset, with target to non target proportion in population approx as 1%:99%. There are around 0.5 million records in ...
0
votes
0answers
44 views

Sample size for binary text classification

In my application as a Binary text classification, one class has around 36,000 sample and another one has around 300 samples. I under-sample the first class. So, each class will have ~ 300 samples. ...
2
votes
1answer
166 views

classification threshold in RandomForest-sklearn

1) How can I change classification threshold (i think it is 0.5 by default) in RandomForest in sklearn? 2) how can I under-sample in sklearn? 3) I have the following result from RandomForest ...
0
votes
0answers
52 views

Model selection for unbalanced data

How to do model selection for unbalanced data? how many data points from the whole data set should be selected for model selection? how many for training and testing?
0
votes
2answers
485 views

Dataset of repeated measures with unbalanced sample size and unequal variace - What to do?

I have a dataset of three groups of cells treated with 10 different compounds and am not sure how to check for significant differences between those treatments. Within each group the data is also ...