Linked Questions

2 votes
2 answers
17k views

How to select a threshold for logistic regression in case of imbalance in class distribution [duplicate]

Consider the model fit2 <- glm(y~x+z,data=records,family=binomial) I have about 42000 records, of which close to 38000 belong to class y=0 and the remaining 4000 belong to class y=1. In order for ...
rk567's user avatar
  • 701
4 votes
2 answers
4k views

How to perform logistic regression with unbalanced classes? [duplicate]

I will be doing a logistic regression to determine if a number of variables influence whether or not a patient received a certain health care service. I will likely have approximately 500 or so ...
KARLA LANCASTER's user avatar
4 votes
1 answer
1k views

Probability prediction using logistic regression for an unbalanced dataset [duplicate]

I am trying to estimate the probability for a user to get to a specific page in a website. The collected information for the users are countries whether they use a PC or a mobile device referral ...
Mattia Paterna's user avatar
5 votes
1 answer
3k views

Logistic Regression with Unbalanced Data [duplicate]

I have a binary dataset which is 99% in one class and 1% in the other class. I MUST create a logistic regression. I have read literature that says both using this dataset as is, or over/undersampling ...
Jim's user avatar
  • 61
3 votes
1 answer
2k views

statistical modelling for imbalanced data [duplicate]

I am dealing with a binary response (good/ bad) type data set of size 2153, which reflects a dependent variable. Out of these, only 67 are in favor of "bad" and the remaining are of "good". Also, i ...
kuwoli's user avatar
  • 479
8 votes
2 answers
1k views

Should we balance the data set if the data is intrinsically unbalanced? [duplicate]

Say I want to predict the cancer rate(regression)/predict the whether a person has cancer or not(classification). The data intrinsically has few cancer patients/low cancer rate, say 1/200. And the ...
G. Yu's user avatar
  • 101
1 vote
1 answer
2k views

logistic regression - unbalanced classes [duplicate]

Let's suppose I have a dataset with classes A and B, with class A occurring in 1% of cases and class B occurring in 99% of cases. Perhaps class A is a loan default. Suppose I want to "understand" ...
convolutedstatistic's user avatar
0 votes
1 answer
920 views

problems in doing logistic regression with unbalanced sample, give me some references [duplicate]

I have a dataset with lots Y=0 and few Y=1. I have to run logistic regression, so I'm using a retrospective sample in order to get a more balanced sample. Could someone give me some references that ...
Luca Dibo's user avatar
  • 457
2 votes
2 answers
258 views

Class Imbalance [duplicate]

What are the best practices for fitting a binomial classification model when the classes are very imbalanced? For example, 99.9% 1's and 0.1% 0's.
power's user avatar
  • 1,722
0 votes
0 answers
1k views

How to do logistic regression with unequal groups in the dependent variable? [duplicate]

I try to figure out how a logistic regression is handling data with a 0/1 dependent variable. 95% of the data are ones. The purpose of the model is to estimate the probability to be in one of the ...
Sebastian's user avatar
  • 213
1 vote
3 answers
1k views

How to deal with Class imbalance problem for classification algorithms? [duplicate]

Lets say for fraud detection which has two labels for each transaction. Fraud Non fraud In real world scenario we usually get more number of examples of Non fraud data points and very low number ...
Aakash Nand's user avatar
1 vote
0 answers
892 views

Extremely unequal sample size in logistic regression [duplicate]

Possible Duplicate: Does an unbalanced sample matter when doing logistic regression? I’m hoping for help on dealing with unequal sample sizes for logistic regression analysis. Any assistance is ...
Leona's user avatar
  • 81
0 votes
1 answer
806 views

Sample Selection Bias in Logistic Regression [duplicate]

I'm working on a classification problem where I expect $True\ Positive\ Rate =0.999$ $True\ Negative\ Rate = 0.001$ To model this data, I have created a training set with an equal proportion of ...
bobster345's user avatar
2 votes
2 answers
388 views

Alternatives to logistic regression when data is unbalanced [duplicate]

Using Python's pandas, sklearn, and stats models API, I have trained a logistic regression on a training dataset that tells me whether or not a particular purchase (based on gender, and other features)...
user45254's user avatar
  • 123
3 votes
1 answer
497 views

Effect of class imbalance on logistic regression (mathematical basis) [duplicate]

A number of posts, and papers, state that logistic regression (LR) is robust in the face of class imbalance. Unless the imbalance is extreme (e.g., events=0.01 or less), with adequate sample sizes ...
Gordon's user avatar
  • 31

15 30 50 per page
1
2 3 4 5 6