Skip to main content
edited tags
Link
Scortchi
  • 31.6k
  • 9
  • 102
  • 282
removed obsolete info
Source Link

First of all, if this question is a dup, please let me know before voting it down. I spent a good half hour reading all Q&As and I don't think I have found my answer.

I have been running logit regressions on large samples in order of hundreds of thousands in a preliminary study that will eventually end up in non-parametric tests. Both my dependent variable and my independent variable of interest are binary for now. I started with a very underspecified model containing only my IV of interest in a single logit regression. Since the dataset is quite large, I haven't been putting much trust into the significance level of my coefficients which seem to be almost always perfect. Instead, I have been calculating odds ratios that can give me some kind of indication of the predictive power of the model. While I was running my underspecified regression (glm(dv ~ iv, family = binomial(link = logit)) on preliminary noisy data the odds ratios seemed to be at an acceptable level, so I decided to proceed to the next step, clean the data and import the control variables, etc...

Now the issue is: since I have started using the full clean data with real control variables, the odds ratios of my variable of interest have started exploding.

Consider this:

glm(clean_dv ~ clean_iv, family = binomial(link = logit))

clean_iv coefficient: 4.619625

clean_iv stderr: 0.267083

clean_iv odds: 101.45602

glm(clean_dv ~ clean_iv+noisy_cv1+noisy_cv2, family = binomial(link = logit))

clean_iv coefficient: 6.233e+00

clean_iv stderr: 2.727e-01

clean_iv odds: 509.3612309

glm(clean_dv ~ clean_iv+clean_cv1+clean_cv2, family = binomial(link = logit))

clean_iv coefficient: 5.582e+00

clean_iv stderr: 2.369e-01

clean_iv odds: 265.6611359

The control variables behave just normally. They are significant and have acceptable odds ratios.

Better odds ratios should supposedly be good news, but at this level I don't know how to interpret them anymore. Any help is appreciated.

P.S. On the last model with very large odds ratio STATA won't converge anymore, and only R's logit model works. For the first two models STATA produces roughly the same odds ratios and coefficients as R.

First of all, if this question is a dup, please let me know before voting it down. I spent a good half hour reading all Q&As and I don't think I have found my answer.

I have been running logit regressions on large samples in order of hundreds of thousands in a preliminary study that will eventually end up in non-parametric tests. Both my dependent variable and my independent variable of interest are binary for now. I started with a very underspecified model containing only my IV of interest in a single logit regression. Since the dataset is quite large, I haven't been putting much trust into the significance level of my coefficients which seem to be almost always perfect. Instead, I have been calculating odds ratios that can give me some kind of indication of the predictive power of the model. While I was running my underspecified regression (glm(dv ~ iv, family = binomial(link = logit)) on preliminary noisy data the odds ratios seemed to be at an acceptable level, so I decided to proceed to the next step, clean the data and import the control variables, etc...

Now the issue is: since I have started using the full clean data with real control variables, the odds ratios of my variable of interest have started exploding.

Consider this:

glm(clean_dv ~ clean_iv, family = binomial(link = logit))

clean_iv coefficient: 4.619625

clean_iv stderr: 0.267083

clean_iv odds: 101.45602

glm(clean_dv ~ clean_iv+noisy_cv1+noisy_cv2, family = binomial(link = logit))

clean_iv coefficient: 6.233e+00

clean_iv stderr: 2.727e-01

clean_iv odds: 509.3612309

glm(clean_dv ~ clean_iv+clean_cv1+clean_cv2, family = binomial(link = logit))

clean_iv coefficient: 5.582e+00

clean_iv stderr: 2.369e-01

clean_iv odds: 265.6611359

The control variables behave just normally. They are significant and have acceptable odds ratios.

Better odds ratios should supposedly be good news, but at this level I don't know how to interpret them anymore. Any help is appreciated.

P.S. On the last model with very large odds ratio STATA won't converge anymore, and only R's logit model works. For the first two models STATA produces roughly the same odds ratios and coefficients as R.

I have been running logit regressions on large samples in order of hundreds of thousands in a preliminary study that will eventually end up in non-parametric tests. Both my dependent variable and my independent variable of interest are binary for now. I started with a very underspecified model containing only my IV of interest in a single logit regression. Since the dataset is quite large, I haven't been putting much trust into the significance level of my coefficients which seem to be almost always perfect. Instead, I have been calculating odds ratios that can give me some kind of indication of the predictive power of the model. While I was running my underspecified regression (glm(dv ~ iv, family = binomial(link = logit)) on preliminary noisy data the odds ratios seemed to be at an acceptable level, so I decided to proceed to the next step, clean the data and import the control variables, etc...

Now the issue is: since I have started using the full clean data with real control variables, the odds ratios of my variable of interest have started exploding.

Consider this:

glm(clean_dv ~ clean_iv, family = binomial(link = logit))

clean_iv coefficient: 4.619625

clean_iv stderr: 0.267083

clean_iv odds: 101.45602

glm(clean_dv ~ clean_iv+noisy_cv1+noisy_cv2, family = binomial(link = logit))

clean_iv coefficient: 6.233e+00

clean_iv stderr: 2.727e-01

clean_iv odds: 509.3612309

glm(clean_dv ~ clean_iv+clean_cv1+clean_cv2, family = binomial(link = logit))

clean_iv coefficient: 5.582e+00

clean_iv stderr: 2.369e-01

clean_iv odds: 265.6611359

The control variables behave just normally. They are significant and have acceptable odds ratios.

Better odds ratios should supposedly be good news, but at this level I don't know how to interpret them anymore. Any help is appreciated.

results corrected after modifying model according to suggestions
Source Link

Very large odds ratio (~2.8e+06558) in logit regressions (R)

First of all, if this question is a dup, please let me know before voting it down. I spent a good half hour reading all Q&As and I don't think I have found my answer.

I have been running logit regressions on large samples in order of hundreds of thousands in a preliminary study that will eventually end up in non-parametric tests. Both my dependent variable and my independent variable of interest are binary for now. I started with a very underspecified model containing only my IV of interest in a single logit regression. Since the dataset is quite large, I haven't been putting much trust into the significance level of my coefficients which seem to be almost always perfect. Instead, I have been calculating odds ratios that can give me some kind of indication of the predictive power of the model. While I was running my underspecified regression (glm(dv ~ iv, family = binomial(link = logit)) on preliminary noisy data the odds ratios seemed to be at an acceptable level, so I decided to proceed to the next step, clean the data and import the control variables, etc...

Now the issue is: since I have started using the full clean data with real control variables, the odds ratios of my variable of interest have started exploding.

Consider this:

glm(clean_dv ~ clean_iv, family = binomial(link = logit))

clean_iv coefficient: 4.619625

clean_iv stderr: 0.267083

clean_iv odds: 101.45602

glm(clean_dv ~ clean_iv+noisy_cv1+noisy_cv2, family = binomial(link = logit))

clean_iv coefficient: 6.233e+00

clean_iv stderr: 2.727e-01

clean_iv odds: 509.3612309

glm(clean_dv ~ clean_iv+clean_cv1+clean_cv2, family = binomial(link = logit))

clean_iv coefficient: 15.484e+01582e+00

clean_iv stderr: 42.977e369e-01

clean_iv odds: 2265.796045e+066611359

The control variables behave just normally. They are significant and have acceptable odds ratios.

Better odds ratios should supposedly be good news, but at this level I don't know how to interpret them anymore. Any help is appreciated.

P.S. On the last model with very large odds ratio STATA won't converge anymore, and only R's logit model works. For the first two models STATA produces roughly the same odds ratios and coefficients as R.

Very large odds ratio (~2.8e+06) in logit regressions (R)

First of all, if this question is a dup, please let me know before voting it down. I spent a good half hour reading all Q&As and I don't think I have found my answer.

I have been running logit regressions on large samples in order of hundreds of thousands in a preliminary study that will eventually end up in non-parametric tests. Both my dependent variable and my independent variable of interest are binary for now. I started with a very underspecified model containing only my IV of interest in a single logit regression. Since the dataset is quite large, I haven't been putting much trust into the significance level of my coefficients which seem to be almost always perfect. Instead, I have been calculating odds ratios that can give me some kind of indication of the predictive power of the model. While I was running my underspecified regression (glm(dv ~ iv, family = binomial(link = logit)) on preliminary noisy data the odds ratios seemed to be at an acceptable level, so I decided to proceed to the next step, clean the data and import the control variables, etc...

Now the issue is: since I have started using the full clean data with real control variables, the odds ratios of my variable of interest have started exploding.

Consider this:

glm(clean_dv ~ clean_iv, family = binomial(link = logit)

clean_iv coefficient: 4.619625

clean_iv stderr: 0.267083

clean_iv odds: 101.45602

glm(clean_dv ~ clean_iv+noisy_cv1+noisy_cv2, family = binomial(link = logit)

clean_iv coefficient: 6.233e+00

clean_iv stderr: 2.727e-01

clean_iv odds: 509.3612309

glm(clean_dv ~ clean_iv+clean_cv1+clean_cv2, family = binomial(link = logit)

clean_iv coefficient: 1.484e+01

clean_iv stderr: 4.977e-01

clean_iv odds: 2.796045e+06

The control variables behave just normally. They are significant and have acceptable odds ratios.

Better odds ratios should supposedly be good news, but at this level I don't know how to interpret them anymore. Any help is appreciated.

P.S. On the last model with very large odds ratio STATA won't converge anymore, and only R's logit model works. For the first two models STATA produces roughly the same odds ratios and coefficients as R.

Very large odds ratio (558) in logit regressions

First of all, if this question is a dup, please let me know before voting it down. I spent a good half hour reading all Q&As and I don't think I have found my answer.

I have been running logit regressions on large samples in order of hundreds of thousands in a preliminary study that will eventually end up in non-parametric tests. Both my dependent variable and my independent variable of interest are binary for now. I started with a very underspecified model containing only my IV of interest in a single logit regression. Since the dataset is quite large, I haven't been putting much trust into the significance level of my coefficients which seem to be almost always perfect. Instead, I have been calculating odds ratios that can give me some kind of indication of the predictive power of the model. While I was running my underspecified regression (glm(dv ~ iv, family = binomial(link = logit)) on preliminary noisy data the odds ratios seemed to be at an acceptable level, so I decided to proceed to the next step, clean the data and import the control variables, etc...

Now the issue is: since I have started using the full clean data with real control variables, the odds ratios of my variable of interest have started exploding.

Consider this:

glm(clean_dv ~ clean_iv, family = binomial(link = logit))

clean_iv coefficient: 4.619625

clean_iv stderr: 0.267083

clean_iv odds: 101.45602

glm(clean_dv ~ clean_iv+noisy_cv1+noisy_cv2, family = binomial(link = logit))

clean_iv coefficient: 6.233e+00

clean_iv stderr: 2.727e-01

clean_iv odds: 509.3612309

glm(clean_dv ~ clean_iv+clean_cv1+clean_cv2, family = binomial(link = logit))

clean_iv coefficient: 5.582e+00

clean_iv stderr: 2.369e-01

clean_iv odds: 265.6611359

The control variables behave just normally. They are significant and have acceptable odds ratios.

Better odds ratios should supposedly be good news, but at this level I don't know how to interpret them anymore. Any help is appreciated.

P.S. On the last model with very large odds ratio STATA won't converge anymore, and only R's logit model works. For the first two models STATA produces roughly the same odds ratios and coefficients as R.

minor correction to results
Source Link
Loading
enhanced readability of results
Source Link
Loading
Source Link
Loading