Data organized into discrete categories or *classes* may present problems for certain analyses if the number of observations ($n$) belonging to each class is not constant across classes. Classes with unequal $n$ are *unbalanced*.

learn more… | top users | synonyms

0
votes
3answers
172 views

How to deal with a skewed class in binary classification having many features?

I am doing data analysis in the mobile ad targeting domain. I have around 18 features and for a combination of these features, the result is either True or False (1/0) depending on whether the ...
0
votes
0answers
22 views

Classification Algorithm For Small Sample Sizes

I am looking at a problem now where I need to train a classification algorithm. There are only 2 classes, lets call them A and B, and I want a value between zero and one indicating the probability ...
1
vote
1answer
87 views

Selection bias and reliability

I need a bit of help with interpretation of classification results. I have unbalanced data set (80% = 0 20% = 1), fitting classifiers (SVM, GradientBoosting or kNN) on such data does not yield good ...
0
votes
0answers
17 views

Optimize Probability Thresholds for class imbalances in glmnet models in caret

In direct relation to the topic discussed here I intend to retrain the model in order to optimize the probability threshold for classification of both classes. Currently the model achieves high ...
0
votes
1answer
43 views

Choosing a good binary classifier to be trained by a small set of labeled data

I have a small set of labeled data (diagnosis in individual subjects): ~50 of "sick" observations ~100 of "healthy" observations In reality, only ~1% of the observations are expected to be ...
1
vote
1answer
94 views

Finding the best dataset for classification

I have 100 datasets. All of them have varying number of features. There are around 20,000 samples in each of them. Every $i$-th sample in the 100 datasets has the same label ($0/1$). The data is ...
2
votes
1answer
38 views

What does it actually mean for classes to be balanced?

I saw the following statement when reading Kuhn's APM: "The classes are fairly balanced; there are 111 samples in the first class and 97 in the second..." I thought balance would require the ...
2
votes
1answer
86 views

Finding occurrences of specific patterns in time series

I have to locate occurrences of Cyllinder, Bell and Funnel patterns in univariate time series $X$ of gamma-ray sensoring. This is a specific case of the general CBF synthetic problem found in a few ...
2
votes
1answer
44 views

How can I derive confidence intervals from the confusion matrix for a classifier?

I have am using k-fold cross validation to generate a confusion matrix for a classifier. I need to calculate 95% confidence intervals for the number of times each class is predicted when run against a ...
0
votes
0answers
26 views

unbalanced groups in mixed design ANOVA

I want to perform a mixed design ANOVA. Time is the within subjects factor and the between subjects factor is Borderline, which is a categorical variable (borderline yes or no). There are 30 people ...
1
vote
0answers
14 views

Unbalanced groups and classification errors

I would like to adopt a general strategy for dealing with an very unbalanced dataset, where my "positive" group corresponds to 1/40 of all the observations. The reason why I ask it is because all the ...
0
votes
0answers
13 views

Non idependence within groups

I have to train a machine learning model for classifying two groups. Unfortunately, my positive group has a small number and many cases are not independent from each other (observations taken in ...
1
vote
3answers
104 views

Class imbalance in Supervised Machine Learning

This is a question in general, not specific to any method or data set. How do we deal with a class imbalance problem in Supervised Machine learning where the number of 0 is around 90% and number of 1 ...
1
vote
2answers
62 views

Balanced datasets in Naive Bayes

In a classification model, a desirable situation is to have classification classes evenly represented in the training dataset. Datasets that satisfy this property are called balanced datasets. ...
1
vote
0answers
19 views

Non-parametric Levene's test by Nordstokke and Zumbo

The example they mention is using a one-way ANOVA. What if I have two factors (3x11) and a dependent variable, can I do a two-way ANOVA to calculate the univariate levene's test? If so, how would I ...
0
votes
0answers
83 views

Best machine learning methtod for classificating datasets with non-independent cases within the groups

I have to perform binary classification of my data with supervised machine learning, but I have some difficulties working with my data set. It consists many genetic mutations that have parameters ...
1
vote
1answer
52 views

ROC curves for unbalanced datasets

Consider an input matrix $X$ and a binary output $y$. A common way to measure the performance of a classifier is to use ROC curves. In a ROC plot the diagonal is the result that would be obtained ...
0
votes
0answers
10 views

P-values for random effects when using REML [duplicate]

I'm using JMP to fit a model for an unbalanced split-plot design. Because it's unbalanced, I'm using REML rather than EMS. However, I would like to get test statistics/p-values for some of the random ...
0
votes
2answers
91 views

Choosing the best featureset for prediction

I have this N sets of features F each with $F_i$ number of features. All the feature sets have 20000 examples and we have 20,000 labels for them. Lets say feature set $F_1$ has 10 features and ...
1
vote
2answers
49 views

Class Imbalance

What are the best practices for fitting a binomial classification model when the classes are very imbalanced? For example, 99.9% 1's and 0.1% 0's.
1
vote
1answer
35 views

How to judge a partition is balanced or unbalanced?

Suppose we distributed $100$ coins to $10$ persons and the $i$-th person got ${x}_{i}$ coins, how to judge the distribution $X=\{{x}_{1}, {x}_{2}, ..., {x}_{n}\}$ (e.g., $X=\{5, 20, 15, 5, 10, 10, 10, ...
4
votes
1answer
49 views

Is up- or down-sampling imbalanced data actually that effective? Why?

I frequently hear up- or down-sampling of data discussed as a way of dealing with classification of imbalanced data. I understand that this could be useful if you're working with a binary (as opposed ...
0
votes
0answers
24 views

positive and negative sample count for ConvNets

I have been trying to set up a ConvNet to classify some data. This data should be classified to either 1 (being what I need to get from the image) and 0 for everything that is irrelevant. I have ...
0
votes
1answer
22 views

Affect of Misclassification Cost on SVM

I am using Matlab to train an SVM for very unbalanced data. However, my concern is not so much for the particular class assignment (ie 1/0), but rather to the scores (the prethreshold continuous SVM ...
0
votes
1answer
39 views

multiclass classification and unbalanced dataset

I have a five-class SVM multiclass problem. The dataset is small (about 160 examples) and unbalanced i.e. I have classes with few examples. So far I further limited the dataset to 110 examples in ...
3
votes
1answer
1k views

Using AdaBoost on multi-class in R on unbalanced data

I have a data set which is highly imbalanced and I have used the SMOTE algorithm (using the R package DMwR) to balance the binary class in the data set. I have been using the R Ada package to then ...
1
vote
1answer
74 views

Permutation on multiple Pairwise Comparison with least square means in R 3.1.2

I'm working on a study where I employed an analysis of covariance (Ancova) with unbalanced factors. I used permutation tests to obtain p-values for my estimates since my observation does not come from ...
0
votes
0answers
9 views

comparing probability of imbalance classes

I am trying to figure out what id the standard way to compare the probability of occurrence of two imbalances classes: let say there 1500 web pages with different languages edition (e.g. Wikipedia). ...
0
votes
0answers
41 views

cost matrix, unbalanced class, oversampling and threshold probability

Let's suppose I have a cost matrix with TP=+90 FP=-10 TN=0 and FN=-10, and that the class is unbalanced. I need to capture the costs in my decision. To do so, I always consider the probability ...
0
votes
1answer
65 views

Binary classification in imbalanced data

I have a binary classification problem where my data is highly imbalanced (80:20). Given this imbalance is present in both training and test set, does it make sense to apply specific strategies during ...
0
votes
0answers
40 views

SVM One-vs-One vs One-vs-ALL SVM

For an unbalanced dataset annotated by human annotators in which each item is assigned to different classes, what is the argument for and against using any of One-vs-One vs One-vs-ALL SVM ...
2
votes
1answer
104 views

Has anyone publicly shared an implementation of RUSBoost in R?

There's no package available on CRAN, so I was hoping someone in the community had written their own function/package. I see it's been done in MATLAB, so I may just have to start with that and write ...
3
votes
2answers
121 views

Does Support Vector Machine handle imbalanced Dataset?

Does SVM handles imbalanced dataset? Is that any parameters (like C, or misclassification cost) handling the imbalanced dataset?
0
votes
1answer
354 views

Imbalanced data classification using boosting algorithms

I am working on a binary data classification problem. The dataset is imbalanced, it consists of 92% 'false' labels and 8% 'true' labels. The number of features is 18 and I have a small number of 650 ...
0
votes
1answer
181 views

Which post-hoc is more valid for multiple comparison of an unbalanced lmer-model: lsm or mcp?

After doing a model comparison with my mixed lmer model, I have a model with three main effects, no interaction, say ...
1
vote
1answer
54 views

LSmeans - Unbalanced data with interactions

I wish to analyze an unbalanced data set with 3 variables Tleaf, Tair, and orientation (factor with two levels). Considering the effect of the factor "orientation", I wish to determine if "Tair" has a ...
1
vote
0answers
114 views

Any advice on how to improve my accuracy rate in text classification?

I'm trying to do a text classification task. Here are some specs: Context file size = 1M+ documents already labeled Number of top-labels = 17 Number of sub-labels = around 130 Each document is ...
2
votes
3answers
493 views

Suggestions for cost-sensitive learning in a highly imbalanced setting

I have a dataset with a few million rows and ~100 columns. I would like to detect about 1% of the examples in the dataset, which belong to a common class. I have a minimum precision constraint, but ...
0
votes
0answers
38 views

dealing with imbalanced data set in multiclass text classification

I need to build a text classification model. I have a labeled training set and my goal is to classify the new unlabeled text . My training set is composed on 6 categories, that are imbalanced. The ...
0
votes
0answers
87 views

unary classification in PyBrain

I've just started using PyBrain for some data classification work, and I've gotten it working pretty well where I have data from all possible classes and I can train the network using all the classes. ...
0
votes
0answers
47 views

Unbalanced groups in a Hierarchical Linear Model

I would appreciate some practical and/or conceptual advice on sample sizes in a two level hierarchical linear model. A lot of the material on sample sizes and HLM is about the number of level 2 ...
1
vote
0answers
9 views

Multiclass target detection : N X (1 vs all) or 1 X (N vs all) ?

I am doing a multiclass classification using neural networks. say I have 10 target classes and one null (non-of-the-above-targets). is it better that I train a neural network separately for each ...
1
vote
2answers
64 views

If one group has 23 participants and the second group has 117 participants in it, can we rely on the result of t-test? [duplicate]

I was evaluating a research paper in which the authors have 23 male participants and 117 female participants. They have applied t-test to calculate Gender differences and have even concluded on ...
1
vote
3answers
78 views

Significant main effect in one-way, but not in two-way, MANOVA

I used a one-way MANOVA to study the effect of age groups on the average of height and weight and found that they were significant. Then I used a two-way MANOVA to study the effect of age groups and ...
0
votes
3answers
736 views

Correlation and group difference with unequal sample sizes

My sample is 60 participants. At first, I did not expect to analyze the correlation, but the result is interesting, so I would like to. The 60 participants are 50 people who have good reading skill ...
0
votes
2answers
1k views

Dataset of repeated measures with unbalanced sample size and unequal variace - What to do?

I have a dataset of three groups of cells treated with 10 different compounds and am not sure how to check for significant differences between those treatments. Within each group the data is also ...
2
votes
0answers
106 views

Average of predicted values with logistic regression

I have a large unbalanced dataset (the target has ~1500x more 0's than 1's) on which I train a logistic regression algorithm to predict the probability of success (Not a binary outcome but a real ...
3
votes
2answers
302 views

Named entity recognition and class imbalance

I have implemented Maximum-entropy Markov model (MEMM) for the Named entity recognition (NER) problem. I have four classes: geographical, people, material (book titles etc) and other. Class ...
2
votes
0answers
117 views

Unbalanced panel data: Fixed effects?

I have an unbalanced panel dataset with N=10 firms and T=61 days. Because one variable had values outside the theoretical range I had to constrain my dataset, which left me with only 239 observations. ...