Data organized into discrete categories or *classes* may present problems for certain analyses if the number of observations ($n$) belonging to each class is not constant across classes. Classes with unequal $n$ are *unbalanced*.

learn more… | top users | synonyms

1
vote
2answers
42 views

what is the difference between area under roc and weighted area under roc?

Thanks in advance for the help. I have an unbalanced dataset that I am using for a binary classification problem. The classes are unbalanced. I believe that in such a case that weighted area under ...
2
votes
1answer
55 views

What balancing method can I apply to a imbalanced data set?

I'm trying to solve one classification problem from the UCI database repository. Unfortunately (or fortunately), I've noticed that my dataset is imbalanced. I've structured the data as 5 classes, ...
1
vote
1answer
111 views

Finding the best dataset for classification

I have 100 datasets. All of them have varying number of features. There are around 20,000 samples in each of them. Every $i$-th sample in the 100 datasets has the same label ($0/1$). The data is ...
0
votes
0answers
12 views

What type of curve to use in object detection task to measure performance of detector?

I have an object detection task with one object type(one object type + background = object detection with sliding window as binary classification of each window). And my data is unbalanced(many ...
0
votes
0answers
31 views

Balancing random forest via cross validation. Difference between sample weight and cutoffs?

My random forest model of a simple binary target (0, 1) and is producing unbalanced results. i.e many more false positives than there are false negatives. In addition, '1' is a low percentage class, ...
2
votes
1answer
91 views

Improving SVM classification

I have a classification problem (bioinformatics domain) where I have around 333 features. Currently, I am first selecting features (using importance feature of random forest) and then pushing the same ...
2
votes
1answer
98 views

How can I derive confidence intervals from the confusion matrix for a classifier?

I have am using k-fold cross validation to generate a confusion matrix for a classifier. I need to calculate 95% confidence intervals for the number of times each class is predicted when run against a ...
1
vote
1answer
124 views

Selection bias and reliability

I need a bit of help with interpretation of classification results. I have unbalanced data set (80% = 0 20% = 1), fitting classifiers (SVM, GradientBoosting or kNN) on such data does not yield good ...
0
votes
1answer
43 views

Extreme unbalanced design: Group A: 43, Group B: 15,000

I've been asked to review a study comparing two groups, in which Group A=43 subjects and Group B=15,000 subjects. Intuitively, I feel that this is not a valid design, but can't find any specific ...
8
votes
2answers
1k views

Does GBM classification suffer from imbalanced class sizes?

I'm dealing with a supervised binary classification issue. I'd like to use the GBM package to classify individuals as uninfected/infected. I have 15 times more uninfected than infected individuals. I ...
0
votes
0answers
8 views

Model variables don't match stratification variables

Okay, so here's a puzzle that I recently encountered. Suppose I am interested in modeling a treatment effect (measured as a continuous variable) on a population, stratifying on a dichotomous ...
0
votes
3answers
480 views

How to deal with a skewed class in binary classification having many features?

I am doing data analysis in the mobile ad targeting domain. I have around 18 features and for a combination of these features, the result is either True or False (1/0) depending on whether the ...
1
vote
0answers
21 views

Should the number of normal samples always be more than that of anomalous samples in training set for anomaly detection?

I am trying to train an anomaly detection algorithm (one-class svm) on a data set with a few hundred positive samples and several thousands negative examples. Is it mandatory that I train the model ...
0
votes
1answer
41 views

What is the best measure for unbalanced multi-class classification problem?

What are some possible classification metric for an unbalanced problem ? Due to skeweness of the distribution, accuracy value is not so meaningful. For instance, if I predict all the classes to class ...
3
votes
1answer
140 views

How to reduce number of false positives?

I'm trying to solve task called pedestrian detection and I train binary clasifer on two categories positives - people, negatives - background. I have dataset: number of positives= 3752 number of ...
1
vote
2answers
134 views

Classifer for unbalanced dataset?

Is there any classifer that can natively support unbalanced datasets? Or what best practices you can suggest to handle such datasets? For example I want to solve task called "pedestrian detection" ...
0
votes
1answer
75 views

SVM parameter tuning for unbalanced classes (with class weights)

I am trying to run an SVM on an imbalanced dataset (0-90%, 1-10%) using the e1071 package, with the radial kernel. I am using cross-validation to select the best gamma and cost. Additionally, I want ...
2
votes
2answers
669 views

kNN and unbalanced classes

Do you think that unbalanced classes is a big problem for k-nearest neighbor? If so, do you know any smart way to handle this?
1
vote
2answers
42 views

How is the chance-level confusion matrix calculated?

I applied an ML technique on my dataset, and got this confusion matrix: 0 1 0 162 62 1 27 50 Funnily, the overall accuracy is worse than ...
2
votes
1answer
58 views

What is the chance level accuracy in unbalanced classification problems?

Suppose one has a balanced classification problem (50% of 0's and 50% of 1's). In such a case, the so called chance-level accuracy of classifier would be 50%. What is the chance-level accuracy if the ...
2
votes
2answers
85 views

Collecting training data for document classification with unbalanced classes

I have a document classification problem in which the estimated class proportions in the population are severely unbalanced: the population is ~99% class 0 and ~1% class 1. I am using a logistic ...
0
votes
1answer
52 views

Help for interpreting SVM cross-validation results

I am using support vector machines for an unbalanced binary problem (0: 25%, 1: 75%). I do K-fold cross-validation with $K=10$. The metrics I get are: 80% classification accuracy on average for the ...
0
votes
0answers
11 views

Scaling before class rebalancing or after?

I'm training an SVM on my train data, which I'm then trying on my test data to find the accuracy of the algorithm. Would it normally be best to rebalance the class imbalance (2 classes with 60/40 ...
2
votes
1answer
56 views

12 firms and a total of 204 observations, can I use pooled OLS with firm-dummies or should I use fixed factor?

I am studying the effect of government ownership on firm performance, more specifically I am studying the effect of the government reducing their share in companies which are already partly ...
4
votes
3answers
2k views

SVM vs. artificial neural network

I have multiclass unbalanced data (4 class with 15% 25% 45% 15% data in each class). Which method is good for classification of such data- SVM or ANN? UPDATE- Let me make the question little more ...
0
votes
1answer
46 views

Effect of Misclassification Cost on SVM

I am using Matlab to train an SVM for very unbalanced data. However, my concern is not so much for the particular class assignment (ie 1/0), but rather to the scores (the prethreshold continuous SVM ...
1
vote
2answers
82 views

Bias-Variance tradeoff for classifying unbalanced classes

I would like to use Bias-Variance trade-off to evaluate training set size in a classification problem. There are two classes which are not balanced (~70/30) and it seems that the common use of ...
0
votes
0answers
61 views

Nested ANOVA with 3 random effects and unbalanced design

I would like to run a nested ANOVA to test three random effects (secteur, loc nested in secteur, site nested in loc) on the variable A. The design is unbalanced so I used lmer instead of aov. However, ...
0
votes
1answer
45 views

problems in doing logistic regression with unbalanced sample, give me some references

I have a dataset with lots Y=0 and few Y=1. I have to run logistic regression, so I'm using a retrospective sample in order to get a more balanced sample. Could someone give me some references that ...
1
vote
1answer
55 views

Skewed Classification Problem

So I've read around and seen this is a problem. I have a classification problem and 12 variables ... I'm working on getting more, but even if l get the number to 20-30 I feel like the problem will ...
3
votes
1answer
1k views

Using AdaBoost on multi-class in R on unbalanced data

I have a data set which is highly imbalanced and I have used the SMOTE algorithm (using the R package DMwR) to balance the binary class in the data set. I have been using the R Ada package to then ...
2
votes
0answers
42 views

Bias Correction for Large Scale Logistic Regression with Rare Events

I have a large dataset constituted of many ad impressions. My dependent binary variable clicked describe whether or not the ad was clicked on. As you can expect, the number of clicks is about 1000x ...
8
votes
2answers
1k views

Does a big difference in sample sizes matter for an independent t-test?

There is a very confusing question in my mind. I have data, and would like to compare numeric scores between men and women. There is a big difference in those two groups: the number of men is 34, ...
4
votes
2answers
144 views

Finding occurrences of specific patterns in time series

I have to locate occurrences of Cyllinder, Bell and Funnel patterns in univariate time series $X$ of gamma-ray sensoring. This is a specific case of the general CBF synthetic problem found in a few ...
0
votes
0answers
37 views

Classification Algorithm For Small Sample Sizes

I am looking at a problem now where I need to train a classification algorithm. There are only 2 classes, lets call them A and B, and I want a value between zero and one indicating the probability ...
0
votes
0answers
91 views

Optimize Probability Thresholds for class imbalances in glmnet models in caret

In direct relation to the topic discussed here I intend to retrain the model in order to optimize the probability threshold for classification of both classes. Currently the model achieves high ...
0
votes
1answer
96 views

Choosing a good binary classifier to be trained by a small set of labeled data

I have a small set of labeled data (diagnosis in individual subjects): ~50 of "sick" observations ~100 of "healthy" observations In reality, only ~1% of the observations are expected to be ...
2
votes
1answer
51 views

What does it actually mean for classes to be balanced?

I saw the following statement when reading Kuhn's APM: "The classes are fairly balanced; there are 111 samples in the first class and 97 in the second..." I thought balance would require the ...
0
votes
0answers
36 views

unbalanced groups in mixed design ANOVA

I want to perform a mixed design ANOVA. Time is the within subjects factor and the between subjects factor is Borderline, which is a categorical variable (borderline yes or no). There are 30 people ...
2
votes
0answers
31 views

Unbalanced groups and classification errors

I would like to adopt a general strategy for dealing with an very unbalanced dataset, where my "positive" group corresponds to 1/40 of all the observations. The reason why I ask it is because all the ...
0
votes
0answers
14 views

Non idependence within groups

I have to train a machine learning model for classifying two groups. Unfortunately, my positive group has a small number and many cases are not independent from each other (observations taken in ...
3
votes
3answers
823 views

Class imbalance in Supervised Machine Learning

This is a question in general, not specific to any method or data set. How do we deal with a class imbalance problem in Supervised Machine learning where the number of 0 is around 90% and number of 1 ...
1
vote
2answers
113 views

Balanced datasets in Naive Bayes

In a classification model, a desirable situation is to have classification classes evenly represented in the training dataset. Datasets that satisfy this property are called balanced datasets. ...
1
vote
0answers
56 views

Non-parametric Levene's test by Nordstokke and Zumbo

The example they mention is using a one-way ANOVA. What if I have two factors (3x11) and a dependent variable, can I do a two-way ANOVA to calculate the univariate levene's test? If so, how would I ...
0
votes
0answers
114 views

Best machine learning methtod for classificating datasets with non-independent cases within the groups

I have to perform binary classification of my data with supervised machine learning, but I have some difficulties working with my data set. It consists many genetic mutations that have parameters ...
1
vote
1answer
175 views

ROC curves for unbalanced datasets

Consider an input matrix $X$ and a binary output $y$. A common way to measure the performance of a classifier is to use ROC curves. In a ROC plot the diagonal is the result that would be obtained ...
0
votes
0answers
17 views

P-values for random effects when using REML [duplicate]

I'm using JMP to fit a model for an unbalanced split-plot design. Because it's unbalanced, I'm using REML rather than EMS. However, I would like to get test statistics/p-values for some of the random ...
0
votes
2answers
92 views

Choosing the best featureset for prediction

I have this N sets of features F each with $F_i$ number of features. All the feature sets have 20000 examples and we have 20,000 labels for them. Lets say feature set $F_1$ has 10 features and ...
1
vote
2answers
74 views

Class Imbalance

What are the best practices for fitting a binomial classification model when the classes are very imbalanced? For example, 99.9% 1's and 0.1% 0's.