Data organized into discrete categories or *classes* may present problems for certain analyses if the number of observations ($n$) belonging to each class is not constant across classes. Classes with unequal $n$ are *unbalanced*.

learn more… | top users | synonyms

2
votes
1answer
27 views

12 firms and a total of 204 observations, can I use pooled OLS with firm-dummies or should I use fixed factor?

I am studying the effect of government ownership on firm performance, more specifically I am studying the effect of the government reducing their share in companies which are already partly ...
1
vote
1answer
103 views

Finding the best dataset for classification

I have 100 datasets. All of them have varying number of features. There are around 20,000 samples in each of them. Every $i$-th sample in the 100 datasets has the same label ($0/1$). The data is ...
0
votes
3answers
257 views

How to deal with a skewed class in binary classification having many features?

I am doing data analysis in the mobile ad targeting domain. I have around 18 features and for a combination of these features, the result is either True or False (1/0) depending on whether the ...
4
votes
3answers
2k views

SVM vs. artificial neural network

I have multiclass unbalanced data (4 class with 15% 25% 45% 15% data in each class). Which method is good for classification of such data- SVM or ANN? UPDATE- Let me make the question little more ...
0
votes
1answer
28 views

Effect of Misclassification Cost on SVM

I am using Matlab to train an SVM for very unbalanced data. However, my concern is not so much for the particular class assignment (ie 1/0), but rather to the scores (the prethreshold continuous SVM ...
1
vote
2answers
60 views

Bias-Variance tradeoff for classifying unbalanced classes

I would like to use Bias-Variance trade-off to evaluate training set size in a classification problem. There are two classes which are not balanced (~70/30) and it seems that the common use of ...
0
votes
0answers
15 views

Nested ANOVA with 3 random effects and unbalanced design

I would like to run a nested ANOVA to test three random effects (secteur, loc nested in secteur, site nested in loc) on the variable A. The design is unbalanced so I used lmer instead of aov. However, ...
0
votes
1answer
37 views

problems in doing logistic regression with unbalanced sample, give me some references

I have a dataset with lots Y=0 and few Y=1. I have to run logistic regression, so I'm using a retrospective sample in order to get a more balanced sample. Could someone give me some references that ...
1
vote
1answer
20 views

Skewed Classification Problem

So I've read around and seen this is a problem. I have a classification problem and 12 variables ... I'm working on getting more, but even if l get the number to 20-30 I feel like the problem will ...
3
votes
1answer
1k views

Using AdaBoost on multi-class in R on unbalanced data

I have a data set which is highly imbalanced and I have used the SMOTE algorithm (using the R package DMwR) to balance the binary class in the data set. I have been using the R Ada package to then ...
1
vote
1answer
112 views

Selection bias and reliability

I need a bit of help with interpretation of classification results. I have unbalanced data set (80% = 0 20% = 1), fitting classifiers (SVM, GradientBoosting or kNN) on such data does not yield good ...
2
votes
0answers
27 views

Bias Correction for Large Scale Logistic Regression with Rare Events

I have a large dataset constituted of many ad impressions. My dependent binary variable clicked describe whether or not the ad was clicked on. As you can expect, the number of clicks is about 1000x ...
0
votes
1answer
31 views

Extreme unbalanced design: Group A: 43, Group B: 15,000

I've been asked to review a study comparing two groups, in which Group A=43 subjects and Group B=15,000 subjects. Intuitively, I feel that this is not a valid design, but can't find any specific ...
8
votes
2answers
1k views

Does a big difference in sample sizes matter for an independent t-test?

There is a very confusing question in my mind. I have data, and would like to compare numeric scores between men and women. There is a big difference in those two groups: the number of men is 34, ...
4
votes
2answers
117 views

Finding occurrences of specific patterns in time series

I have to locate occurrences of Cyllinder, Bell and Funnel patterns in univariate time series $X$ of gamma-ray sensoring. This is a specific case of the general CBF synthetic problem found in a few ...
0
votes
0answers
28 views

Classification Algorithm For Small Sample Sizes

I am looking at a problem now where I need to train a classification algorithm. There are only 2 classes, lets call them A and B, and I want a value between zero and one indicating the probability ...
0
votes
0answers
49 views

Optimize Probability Thresholds for class imbalances in glmnet models in caret

In direct relation to the topic discussed here I intend to retrain the model in order to optimize the probability threshold for classification of both classes. Currently the model achieves high ...
0
votes
1answer
64 views

Choosing a good binary classifier to be trained by a small set of labeled data

I have a small set of labeled data (diagnosis in individual subjects): ~50 of "sick" observations ~100 of "healthy" observations In reality, only ~1% of the observations are expected to be ...
2
votes
1answer
48 views

What does it actually mean for classes to be balanced?

I saw the following statement when reading Kuhn's APM: "The classes are fairly balanced; there are 111 samples in the first class and 97 in the second..." I thought balance would require the ...
2
votes
1answer
57 views

How can I derive confidence intervals from the confusion matrix for a classifier?

I have am using k-fold cross validation to generate a confusion matrix for a classifier. I need to calculate 95% confidence intervals for the number of times each class is predicted when run against a ...
0
votes
0answers
31 views

unbalanced groups in mixed design ANOVA

I want to perform a mixed design ANOVA. Time is the within subjects factor and the between subjects factor is Borderline, which is a categorical variable (borderline yes or no). There are 30 people ...
1
vote
0answers
21 views

Unbalanced groups and classification errors

I would like to adopt a general strategy for dealing with an very unbalanced dataset, where my "positive" group corresponds to 1/40 of all the observations. The reason why I ask it is because all the ...
0
votes
0answers
13 views

Non idependence within groups

I have to train a machine learning model for classifying two groups. Unfortunately, my positive group has a small number and many cases are not independent from each other (observations taken in ...
2
votes
3answers
539 views

Class imbalance in Supervised Machine Learning

This is a question in general, not specific to any method or data set. How do we deal with a class imbalance problem in Supervised Machine learning where the number of 0 is around 90% and number of 1 ...
1
vote
2answers
72 views

Balanced datasets in Naive Bayes

In a classification model, a desirable situation is to have classification classes evenly represented in the training dataset. Datasets that satisfy this property are called balanced datasets. ...
1
vote
0answers
29 views

Non-parametric Levene's test by Nordstokke and Zumbo

The example they mention is using a one-way ANOVA. What if I have two factors (3x11) and a dependent variable, can I do a two-way ANOVA to calculate the univariate levene's test? If so, how would I ...
0
votes
0answers
111 views

Best machine learning methtod for classificating datasets with non-independent cases within the groups

I have to perform binary classification of my data with supervised machine learning, but I have some difficulties working with my data set. It consists many genetic mutations that have parameters ...
1
vote
1answer
71 views

ROC curves for unbalanced datasets

Consider an input matrix $X$ and a binary output $y$. A common way to measure the performance of a classifier is to use ROC curves. In a ROC plot the diagonal is the result that would be obtained ...
0
votes
0answers
10 views

P-values for random effects when using REML [duplicate]

I'm using JMP to fit a model for an unbalanced split-plot design. Because it's unbalanced, I'm using REML rather than EMS. However, I would like to get test statistics/p-values for some of the random ...
0
votes
2answers
92 views

Choosing the best featureset for prediction

I have this N sets of features F each with $F_i$ number of features. All the feature sets have 20000 examples and we have 20,000 labels for them. Lets say feature set $F_1$ has 10 features and ...
1
vote
2answers
56 views

Class Imbalance

What are the best practices for fitting a binomial classification model when the classes are very imbalanced? For example, 99.9% 1's and 0.1% 0's.
1
vote
1answer
41 views

How to judge a partition is balanced or unbalanced?

Suppose we distributed $100$ coins to $10$ persons and the $i$-th person got ${x}_{i}$ coins, how to judge the distribution $X=\{{x}_{1}, {x}_{2}, ..., {x}_{n}\}$ (e.g., $X=\{5, 20, 15, 5, 10, 10, 10, ...
4
votes
1answer
64 views

Is up- or down-sampling imbalanced data actually that effective? Why?

I frequently hear up- or down-sampling of data discussed as a way of dealing with classification of imbalanced data. I understand that this could be useful if you're working with a binary (as opposed ...
0
votes
0answers
29 views

positive and negative sample count for ConvNets

I have been trying to set up a ConvNet to classify some data. This data should be classified to either 1 (being what I need to get from the image) and 0 for everything that is irrelevant. I have ...
0
votes
1answer
82 views

multiclass classification and unbalanced dataset

I have a five-class SVM multiclass problem. The dataset is small (about 160 examples) and unbalanced i.e. I have classes with few examples. So far I further limited the dataset to 110 examples in ...
1
vote
1answer
98 views

Permutation on multiple Pairwise Comparison with least square means in R 3.1.2

I'm working on a study where I employed an analysis of covariance (Ancova) with unbalanced factors. I used permutation tests to obtain p-values for my estimates since my observation does not come from ...
0
votes
0answers
9 views

comparing probability of imbalance classes

I am trying to figure out what id the standard way to compare the probability of occurrence of two imbalances classes: let say there 1500 web pages with different languages edition (e.g. Wikipedia). ...
0
votes
0answers
50 views

cost matrix, unbalanced class, oversampling and threshold probability

Let's suppose I have a cost matrix with TP=+90 FP=-10 TN=0 and FN=-10, and that the class is unbalanced. I need to capture the costs in my decision. To do so, I always consider the probability ...
0
votes
1answer
114 views

Binary classification in imbalanced data

I have a binary classification problem where my data is highly imbalanced (80:20). Given this imbalance is present in both training and test set, does it make sense to apply specific strategies during ...
0
votes
0answers
45 views

SVM One-vs-One vs One-vs-ALL SVM

For an unbalanced dataset annotated by human annotators in which each item is assigned to different classes, what is the argument for and against using any of One-vs-One vs One-vs-ALL SVM ...
2
votes
1answer
139 views

Has anyone publicly shared an implementation of RUSBoost in R?

There's no package available on CRAN, so I was hoping someone in the community had written their own function/package. I see it's been done in MATLAB, so I may just have to start with that and write ...
3
votes
2answers
143 views

Does Support Vector Machine handle imbalanced Dataset?

Does SVM handles imbalanced dataset? Is that any parameters (like C, or misclassification cost) handling the imbalanced dataset?
0
votes
1answer
390 views

Imbalanced data classification using boosting algorithms

I am working on a binary data classification problem. The dataset is imbalanced, it consists of 92% 'false' labels and 8% 'true' labels. The number of features is 18 and I have a small number of 650 ...
0
votes
1answer
340 views

Which post-hoc is more valid for multiple comparison of an unbalanced lmer-model: lsm or mcp?

After doing a model comparison with my mixed lmer model, I have a model with three main effects, no interaction, say ...
1
vote
1answer
65 views

LSmeans - Unbalanced data with interactions

I wish to analyze an unbalanced data set with 3 variables Tleaf, Tair, and orientation (factor with two levels). Considering the effect of the factor "orientation", I wish to determine if "Tair" has a ...
1
vote
0answers
134 views

Any advice on how to improve my accuracy rate in text classification?

I'm trying to do a text classification task. Here are some specs: Context file size = 1M+ documents already labeled Number of top-labels = 17 Number of sub-labels = around 130 Each document is ...
2
votes
3answers
669 views

Suggestions for cost-sensitive learning in a highly imbalanced setting

I have a dataset with a few million rows and ~100 columns. I would like to detect about 1% of the examples in the dataset, which belong to a common class. I have a minimum precision constraint, but ...
0
votes
0answers
51 views

dealing with imbalanced data set in multiclass text classification

I need to build a text classification model. I have a labeled training set and my goal is to classify the new unlabeled text . My training set is composed on 6 categories, that are imbalanced. The ...
0
votes
0answers
102 views

unary classification in PyBrain

I've just started using PyBrain for some data classification work, and I've gotten it working pretty well where I have data from all possible classes and I can train the network using all the classes. ...