17k views

### How to select a threshold for logistic regression in case of imbalance in class distribution [duplicate]

Consider the model fit2 <- glm(y~x+z,data=records,family=binomial) I have about 42000 records, of which close to 38000 belong to class y=0 and the remaining 4000 belong to class y=1. In order for ...
4k views

### How to perform logistic regression with unbalanced classes? [duplicate]

I will be doing a logistic regression to determine if a number of variables influence whether or not a patient received a certain health care service. I will likely have approximately 500 or so ...
1k views

### Probability prediction using logistic regression for an unbalanced dataset [duplicate]

I am trying to estimate the probability for a user to get to a specific page in a website. The collected information for the users are countries whether they use a PC or a mobile device referral ...
3k views

### Logistic Regression with Unbalanced Data [duplicate]

I have a binary dataset which is 99% in one class and 1% in the other class. I MUST create a logistic regression. I have read literature that says both using this dataset as is, or over/undersampling ...
2k views

### statistical modelling for imbalanced data [duplicate]

I am dealing with a binary response (good/ bad) type data set of size 2153, which reflects a dependent variable. Out of these, only 67 are in favor of "bad" and the remaining are of "good". Also, i ...
1k views

### Should we balance the data set if the data is intrinsically unbalanced? [duplicate]

Say I want to predict the cancer rate(regression)/predict the whether a person has cancer or not(classification). The data intrinsically has few cancer patients/low cancer rate, say 1/200. And the ...
1 vote
2k views

### logistic regression - unbalanced classes [duplicate]

Let's suppose I have a dataset with classes A and B, with class A occurring in 1% of cases and class B occurring in 99% of cases. Perhaps class A is a loan default. Suppose I want to "understand" ...
920 views

### problems in doing logistic regression with unbalanced sample, give me some references [duplicate]

I have a dataset with lots Y=0 and few Y=1. I have to run logistic regression, so I'm using a retrospective sample in order to get a more balanced sample. Could someone give me some references that ...
258 views

### Class Imbalance [duplicate]

What are the best practices for fitting a binomial classification model when the classes are very imbalanced? For example, 99.9% 1's and 0.1% 0's.
1k views

### How to do logistic regression with unequal groups in the dependent variable? [duplicate]

I try to figure out how a logistic regression is handling data with a 0/1 dependent variable. 95% of the data are ones. The purpose of the model is to estimate the probability to be in one of the ...
1 vote
1k views

### How to deal with Class imbalance problem for classification algorithms? [duplicate]

Lets say for fraud detection which has two labels for each transaction. Fraud Non fraud In real world scenario we usually get more number of examples of Non fraud data points and very low number ...
1 vote
892 views

### Extremely unequal sample size in logistic regression [duplicate]

Possible Duplicate: Does an unbalanced sample matter when doing logistic regression? I’m hoping for help on dealing with unequal sample sizes for logistic regression analysis. Any assistance is ...
806 views

### Sample Selection Bias in Logistic Regression [duplicate]

I'm working on a classification problem where I expect $True\ Positive\ Rate =0.999$ $True\ Negative\ Rate = 0.001$ To model this data, I have created a training set with an equal proportion of ...
388 views

### Alternatives to logistic regression when data is unbalanced [duplicate]

Using Python's pandas, sklearn, and stats models API, I have trained a logistic regression on a training dataset that tells me whether or not a particular purchase (based on gender, and other features)...