Data organized into discrete categories or *classes* may present problems for certain analyses if the number of observations ($n$) belonging to each class is not constant across classes. Classes with unequal $n$ are *unbalanced*.

learn more… | top users | synonyms

0
votes
2answers
72 views

Correlation and group difference with unequal sample sizes

My sample is 60 participants. At first, I did not expect to analyze the correlation, but the result is interesting, so I would like to. The 60 participants are 50 people who have good reading skill ...
0
votes
2answers
53 views

Choosing the best featureset for prediction

I have this N sets of features F each with $F_i$ number of features. All the feature sets have 20000 examples and we have 20,000 labels for them. Lets say feature set $F_1$ has 10 features and ...
1
vote
1answer
25 views

Questionaire analysis and grouping responses

I want to know if the creative process engagement is related to creativity. I don't know how to analyze the questionnaire. I will be collecting data for cpe with Zhang and Bartal's (2010) 11-item ...
1
vote
1answer
46 views

Finding the best dataset for classification

I have 100 datasets. All of them have varying number of features. There are around 20,000 samples in each of them. Every $i$-th sample in the 100 datasets has the same label ($0/1$). The data is ...
0
votes
1answer
213 views

Dataset of repeated measures with unbalanced sample size and unequal variace - What to do?

I have a dataset of three groups of cells treated with 10 different compounds and am not sure how to check for significant differences between those treatments. Within each group the data is also ...
4
votes
0answers
131 views

Mixed-effects model for a strongly unbalanced design

I am somehow unsure on the best option to analyze these data. Here is my study case: The response variable is a morphometric measure, one for each individual. During 10 years, say 2000-2009, people ...
3
votes
0answers
140 views

Mixed ANOVA: small and unbalanced samples

I have to analyze two samples ($n_1=10, n_2=18$) in a design in which there is a between-subject factor (Groups: 2 levels) and a within-subjects factor (...
3
votes
0answers
136 views

Problem with classifier after using SMOTE to balance the data

We've ran into a problem while training a classifier on an unbalanced data set. The response is binary with 0 indicating 'non defaulter' and 1 indicating 'defaulter' (it's a credit scoring task). ...
3
votes
0answers
209 views

Softmax regression bias and prior probabilities for unequal classes

I'm using Softmax regression for a multi-class classification problem. I don't have equal prior probabilities for each of the classes. I know from Logistic Regression (softmax regression with 2 ...
2
votes
0answers
157 views

How to use k nearest neighbours for binary classification with unbalanced classes?

I have relatively large (100k items) dataset which I need to split in two groups. So far I've tried knn and the results are not good mainly because I have disproportion in my training data: 90% of ...
2
votes
0answers
701 views

Using AdaBoost on multi-class in R on unbalanced data

I have a data set which is highly imbalanced and I have used the SMOTE algorithm (using the R package DMwR) to balance the binary class in the data set. I have been using the R Ada package to then ...
2
votes
0answers
481 views

How to analyze an unbalanced within-subject ANOVA design?

I have data from an experiment involving 4 groups of subjects, 2 possible interventions first and 3 possible intervention at a 2nd point, repeated data measurements from each subjects multiple time ...
1
vote
0answers
129 views

Repeated measures ANOVA for an experiment with missing values (unbalaced)

I have an experiment where several subjects (subjects={S1,S2,..Sm})were asked to perform a set of tasks (tasks={T1, T2, T3, ..Tn}) using both their left (L) and right (R) arms. Each task for each arm ...
1
vote
0answers
75 views

Type I ANOVA tests not depending on the order of the factors

I have a dataset with two factors A and B and the following design (contigency table showing the number of individuals for each ...
1
vote
0answers
85 views

Different Mean Square partitions in an unbalanced bifactorial ANOVA (with random factor) between R and Statistica

I am trying to extract variance components for selection and chance in a bifactorial design with Generation as a fixed factor and Replicate as a random term, for early fecundity. Since I am using ...
1
vote
0answers
172 views

How to compare multiple groups of unblanced repeated measures non normal data?

I'm trying to compare three groups data. But the data set is about a new drug trial. The data set has these characteristics: Follow-up set. That is, after administration of the drug, a series of ...
0
votes
0answers
8 views

How do I partition variance among nested random effects for non-normal data and an unbalanced design?

I have a dataset of plant drought tolerance values (called TLP_DRY) that I would like to partition variance for among the nested levels Biome/Study site/Species to figure out whether most variation in ...
0
votes
0answers
70 views

How to set parameters for SMOTE in WEKA?

How I can choose the most optimal parameters for SMOTE in WEKA. More specifically, how should I pick the nearest-neighbours and the SMOTE to apply? I have been using the amount of SMOTE that gives the ...
0
votes
0answers
31 views

How do you analyse an unbalanced dataset using dummy variables?

I have a returns (finance) dataset with 3 factors, each with 3 levels: industry (banking, retail, others), year (2010, 2011, 2012), and size (small, medium, large). Each factor has been coded as a ...
0
votes
0answers
51 views

Interpreting coefficients for random effects models with extremely unbalanced data

I'm currently working with a data set that has numerous samples collected over time at different sites in a study area, and I'm interested in detecting a trend over time for that area. I know that in ...
0
votes
0answers
25 views

Impact of biased sampling on classifier training ?

Let's imagine I have a very unbalanced dataset with 99.99% of 0 and 0.01% of 1 on the target variable. What I want to do is make a classifier for this target. Now imagine that this dataset is very ...
0
votes
0answers
33 views

Sample size for binary text classification

In my application as a Binary text classification, one class has around 36,000 sample and another one has around 300 samples. I under-sample the first class. So, each class will have ~ 300 samples. ...
0
votes
0answers
44 views

Model selection for unbalanced data

How to do model selection for unbalanced data? how many data points from the whole data set should be selected for model selection? how many for training and testing?
0
votes
0answers
77 views

How to create the class range given 1 as the middle class, 3 as the highest value and 0.65 as the lowest value?

Good day. I know getting the class interval given 3 as the highest value and 0.65 as the lowest value is easy. Here's the catch, the distribution of the interval starts at 1 which is considered as the ...