Linked Questions

2
votes
2answers
13k views

How to select a threshold for logistic regression in case of imbalance in class distribution [duplicate]

Consider the model fit2 <- glm(y~x+z,data=records,family=binomial) I have about 42000 records, of which close to 38000 belong to class y=0 and the remaining 4000 belong to class y=1. In order for ...
4
votes
1answer
592 views

Probability prediction using logistic regression for an unbalanced dataset [duplicate]

I am trying to estimate the probability for a user to get to a specific page in a website. The collected information for the users are countries whether they use a PC or a mobile device referral ...
4
votes
2answers
1k views

How to perform logistic regression with unbalanced classes? [duplicate]

I will be doing a logistic regression to determine if a number of variables influence whether or not a patient received a certain health care service. I will likely have approximately 500 or so ...
5
votes
1answer
2k views

Logistic Regression with Unbalanced Data [duplicate]

I have a binary dataset which is 99% in one class and 1% in the other class. I MUST create a logistic regression. I have read literature that says both using this dataset as is, or over/undersampling ...
0
votes
1answer
820 views

problems in doing logistic regression with unbalanced sample, give me some references [duplicate]

I have a dataset with lots Y=0 and few Y=1. I have to run logistic regression, so I'm using a retrospective sample in order to get a more balanced sample. Could someone give me some references that ...
0
votes
0answers
1k views

How to do logistic regression with unequal groups in the dependent variable? [duplicate]

I try to figure out how a logistic regression is handling data with a 0/1 dependent variable. 95% of the data are ones. The purpose of the model is to estimate the probability to be in one of the ...
1
vote
1answer
1k views

logistic regression - unbalanced classes [duplicate]

Let's suppose I have a dataset with classes A and B, with class A occurring in 1% of cases and class B occurring in 99% of cases. Perhaps class A is a loan default. Suppose I want to "understand" ...
2
votes
2answers
217 views

Class Imbalance [duplicate]

What are the best practices for fitting a binomial classification model when the classes are very imbalanced? For example, 99.9% 1's and 0.1% 0's.
1
vote
3answers
723 views

How to deal with Class imbalance problem for classification algorithms? [duplicate]

Lets say for fraud detection which has two labels for each transaction. Fraud Non fraud In real world scenario we usually get more number of examples of Non fraud data points and very low number ...
3
votes
1answer
605 views

statistical modelling for imbalanced data [duplicate]

I am dealing with a binary response (good/ bad) type data set of size 2153, which reflects a dependent variable. Out of these, only 67 are in favor of "bad" and the remaining are of "good". Also, i ...
1
vote
0answers
449 views

Extremely unequal sample size in logistic regression [duplicate]

Possible Duplicate: Does an unbalanced sample matter when doing logistic regression? I’m hoping for help on dealing with unequal sample sizes for logistic regression analysis. Any assistance is ...
6
votes
2answers
245 views

Should we balance the data set if the data is intrinsically unbalanced? [duplicate]

Say I want to predict the cancer rate(regression)/predict the whether a person has cancer or not(classification). The data intrinsically has few cancer patients/low cancer rate, say 1/200. And the ...
1
vote
0answers
346 views

Logistic regression with unbalanced sampling [duplicate]

Lets say I have a dataframe that looks like this: ...
2
votes
2answers
210 views

Alternatives to logistic regression when data is unbalanced [duplicate]

Using Python's pandas, sklearn, and stats models API, I have trained a logistic regression on a training dataset that tells me whether or not a particular purchase (based on gender, and other features)...
1
vote
0answers
251 views

Classification model on a highly unbalanced dataset [duplicate]

I’m dealing with a highly unbalanced dataset where 20% of data belongs to class A and 80% belongs to class B. It’s very hard for us to produce synthetic class A data. Just wondering if the below ...

15 30 50 per page