Questions tagged [logistic]

Refers generally to statistical procedures that utilize the logistic function, most commonly various forms of logistic regression

2,362 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
0answers
901 views

check for multicollinearity: ordinal logistic regression

I'm currently working on a statistics paper for practice and cannot figure out how to control for multicollinearity if almost all my variables are ordinal. VIF doesn't seem to work for instance. It ...
4
votes
0answers
384 views

Ordered logistic Regression with categorical variables

I am conducting a regression. There is an ordinal dependent variable (ordered from 1 to three) and some categorical independent variables (each of them includes several items). I adopted the ...
4
votes
0answers
338 views

Is one-vs-all logit or multionomial logit regression more accurate?

What is advice of when to use one-vs-all logit or multinomial logit regressions? Most importantly, which one has a higher prediction power? Can one test hypothesis and estimate confidence intervals in ...
4
votes
0answers
656 views

Converting log-odds estimates from glmer table to odds-ratios

I am trying to work out how to express the results of interaction contrasts between two categorical variables in a hierarchical logistic regression, one a two level variable ...
4
votes
0answers
360 views

R bayesglm: Estimates depends on order of variable

I did a logistic regression with bayesglm from package arm. I got different results depending on the order of the variables in the model: ...
4
votes
0answers
543 views

Simulate event rate in logistic regression - Finding the intercept

I want to simulate a logistic regression (using a set of continous and binary confounders with known odds ratios) with a specified probability outcome (e.g. event rate = 0.2). This is actually a ...
4
votes
0answers
151 views

Continuous distributions as independent variable in regression

Problem: My research issue concerns logistic regression where each observation is an area, not a simple point. As such, each independent variable ($x_i$ of $\boldsymbol{X}$) is a distribution of ...
4
votes
0answers
443 views

GLMM with time-series covariance and binary response variable?

I have a binary response variable that was measured at irregular time intervals for a number of individuals. I want to fit a GLMM that accounts for the time-series covariance within individuals. I ...
4
votes
0answers
49 views

Confidence interval for the increase in P(Y=1) from moving between 2 levels of a factor in logistic regression

I have a logistic regression model fit with one categorical variable $x$ that takes value in $\{1,2,3,4,5\}$. In R I have obtained the estimate and standard error for $\beta_0$ and $\beta_1$. The ...
4
votes
0answers
3k views

Does the Box Tidwell test for linearity of the logit require predictors to be in the range [0,1]?

Given a multinomial logistic regression model with 4 independent variables, 4 relevant interactions and a dependent variable with 3 categorical outcomes, I wanted to test for linearity of the logit. ...
4
votes
1answer
661 views

Likelihood of LDA compared to logistic regression

I've come across an interesting exercise. We are given four classification models for binary response and a $d$-dimensional independent variable: A Linear Discriminant Analysis model where the ...
4
votes
0answers
394 views

Useful plots for plotting the errors of a multinomial logistic regression model?

I was wondering what are good ways to visualize the errors made by a multinomial logistic regression model? I can compute the class probabilities and I have the a test set with the real classes and a ...
4
votes
0answers
2k views

Which logistic model is appropriate for longitudinal data?

I have data in longitudinal or clustered format (please see the example below). My response variable is dichotomous. I want to examine which factors explains why a subject in the dataset gets Y=1. In ...
4
votes
0answers
2k views

How to know when to use Kernel SVM and not Linear SVM?

If I have more than 3 features in a dataset, then I can't visualize them to see if my classes are scattered in a non linear fashion. So how do I know when is the right way to use linear model with non-...
4
votes
0answers
313 views

Oaxaca decomposition

When you do a Blinder-Oaxaca decomposition, you get a breakdown of the percent difference between two groups (say disabled and not disabled) that is attributable to the difference in their ...
4
votes
0answers
2k views

Sandwich Estimator in Maximum Likelihood Estimation of Logit

I am estimating a discrete choice model using mixed logit using Halton Draws. So everything is effectively done with MCMC. The code is written in MATLAB. I am using MATLAB's ...
4
votes
0answers
533 views

Errors-in-Variables model for logistic regression

Simple question: I am familiar (though don't have tons of experience) with errors-in-variables regression. From what I have seen, this mostly is used with continuous outcomes in a linear model. A) Is ...
4
votes
0answers
632 views

Difference between spatially autocorrelated logit methods

I am seeking advice on different methods to account for spatial autocorrelation in logit models. I've seen a lot of different models attempt to address all of the issues with spatial logit models (...
4
votes
0answers
212 views

Student classification with Multinomial Logit

I’m analyzing student performance data. In my dataset each row corresponds to a student and each column contains several performance metrics (continuous) and the student type (categorical, 4 types). ...
4
votes
0answers
566 views

Paper showing that logistic regression intercept biased in rare events

I'm studying the logistic regression for estimate the Probability of Default of SME's. Fortunately the event (firm's default) is a rare event. King and Zeng tell us that "logistic regression can ...
4
votes
0answers
367 views

What convergence diagnostics are appropriate for a Bayesian hierarchical logistic regression model?

Using WinBUGS, I fit several Bayesian hierarchical logistic regression models for the mean of a binary response variable conditional on a set of criteria. I am now using CODA in R to determine if my ...
4
votes
0answers
96 views

Rank deficient bootstrap resamples

Despite years of stat courses I'm afraid I may still not completely understand bootstrapping. My question here relates to nonparametric boostrapping of regression models. As i understand it you draw ...
4
votes
0answers
1k views

How to deal with unequal sample sizes while fully embrace a dataset?

Imagine the situation: Mythical Seafolk use holes in the seabed as their burrows. Each hole has two parameters - diameter and depth. Majority of holes are unoccupied due to their surplus (n = 235). ...
4
votes
0answers
805 views

Propensity score matching: using alternative methods to create a distance measure

I would like to use a greedy nearest neighbour method to do propensity score matching. Though I've little experience here, it seems that the distance measure used is generally a propensity score ...
4
votes
0answers
5k views

Clarification on interpreting Wald's test and Likelihood ratio tests

I am running multinomial logistic regression analysis on my data. The response variable is the number of calves produced each year (0,1, or 2). I am trying to evaluate the influence of the X ...
4
votes
0answers
3k views

Comparing ROC-curves

I would like to find if there is a significant difference between two ROC-curves. I've found the roc.test in the pROC package. However, I cannot seem to find any information on how this test is ...
4
votes
0answers
638 views

Creating observed/expected ratio using logistic regression

I am using logistic regression to benchmark the performance of some students in different years. I created a scenario as below: ...
4
votes
0answers
457 views

Equivalence of log linear and logistic regression for categorical variables

This question is similar to Does every log-linear model have a perfectly equivalent logistic regression? but my problem is understanding the proof.Every proof is very similar to the one found on: ...
4
votes
0answers
653 views

Partitioning variance from logistic regression

Short version How can I partition the variance from the different levels in a nested mixed-effects logistic regression? Preferably using R, but even general principles would be helpful as a start. ...
4
votes
0answers
3k views

Binomial logistic regression in SPSS using survey weights

I am running a logistic regression in SPSS with a sample that uses survey weights. The sample size is 1000 and the weights are along the lines of .86 or 1.23 depending on the case. I am using the ...
4
votes
0answers
2k views

Geometric Interpretation of Softmax Regression

I'm writing a series of blog posts on the basics of machine learning, just for fun, mostly to validate my understanding of Andrew Ng's class. As I'm currently studying generalized linear models (GLMs),...
4
votes
0answers
766 views

Normalize binary features for logistic regression

I am applying logistic regression and I am using a mixture of continuous and binary features. My question would be how do you go about binary features when trying to normalize. I would very much ...
4
votes
0answers
919 views

Multinomial Logit with mlogit and Yogurt Data

I am using the mlogit package in R to estimate a choice model, I started with the famous Yogurt dataset. ...
4
votes
0answers
3k views

Measure of goodness-of-fit in Ordinal Logistic Regression with continuous independent variable

In case of the ordinal logistic regression, both of the goodness-of-fit statistics, Pearson and Deviance goodness-of-fit measures, should be used only for models that have reasonably large expected ...
4
votes
0answers
275 views

Logistic regression model for analysis of many IVs with a relatively small sample size

I'm trying to determine the influence (direction and relative strength) of certain attributes of incoming students to an academic program on their successful completion of the program. My sample size ...
4
votes
0answers
426 views

Sensible to include ratio as a variable in logistic regression?

I'm creating a generalised linear regression using a binomial link function for two variables A and B. From looking at the data it appears that A/B may have discriminatory effect. Is it sensible to ...
4
votes
0answers
8k views

How to diagnose multicollinearity using the output of vif function in R?

I am running a logistic regression in R and am attempting to determine if multicollinearity is a problem with my model. When I run vif() on my final model, I get <...
4
votes
0answers
277 views

Dependent variable maximum value contingent on independent variable

I am trying to create a model for debt collections. In the past I have used logistic regression to predict pay/no-pay. This has worked well but has a few unfortunate consequences. People are more ...
4
votes
2answers
888 views

What methods can be used to transform data?

I am solving a binary classification problem with 4 predictor variables. The variables didn't seem to be linearly separable. I have used Neural Networks and Kernel SVM which work and give desired ...
3
votes
0answers
37 views

Derive the closed form of a probability expression

Consider the following probability $$ A\equiv Pr\Big (\delta_1+v+\lambda \epsilon_1\geq \delta_2+v+\lambda \epsilon_2 \text{, } \delta_1+v+\lambda \epsilon_1\geq \epsilon_0 \Big ) $$ where $\lambda\...
3
votes
0answers
41 views

$R^2$ of Logistic Regression Without Intercept?

I am calibrating a logistic regression for a survey data which comes from a binary stated choice experiment. The stated choice experiment was an unlabeled one, which means that all the variables ...
3
votes
2answers
82 views

Is my logistic regression model correct?

I have a factorial design 2*2 (A and B). Both variables with two responses high (coded as 1) and low (coded as 0) and I have a response variable $y$, my logistic model include interaction between A ...
3
votes
1answer
49 views

Can logistic regression be used for variables containing lists?

I'm pretty new into Machine Learning and I was wondering if certain algorithms/models (ie. logistic regression) can handle lists as a value for their variables. Until now I've always used pretty ...
3
votes
1answer
80 views

Does the inclusion of a model offset convert predictor variables from counts to rates?

Does the inclusion of a model offset in Poisson or logistic regression convert predictor variables from counts to rates? Or does it only convert response variables from counts to rates? I understand ...
3
votes
0answers
24 views

Score test for binomial data

I am trying to derive the score test for a logistic regression and I read on Wikipedia that the score test for binomial data (which is used in logistic regression) is the same as the Pearson $\chi^2$-...
3
votes
0answers
48 views

How to interpret a significant factor which has no significant levels?

I did a logistic regression with a single explanatory factor (which is ordered, hence I cannot set the reference level - it has 11 levels, hence when I get the Wald tests the first three are linear, ...
3
votes
0answers
35 views

Regression analysis with multiple categories

I have this data below which I am analyzing using R. First, I am trying to find which predictors (chem1, chem2 and chem3) have effects on yield for this data. I did this model test below and found ...
3
votes
1answer
39 views

Logistic regression with binomial independent variable

I have a table of observations, with three columns --- (a) class labels (can be 0 or 1), (b) counts of successes (out of a certain number of Bernoulli trials) and, (c) numbers of Bernoulli trials. I ...
3
votes
0answers
174 views

derivative of cross entropy yields log-odds, does that make sense?

I am looking for a proof how to derive the logistic regression from cross-entropy loss, i.e. derive the form of a sigmoid from cross entropy. my thoughts are these: $\ell = y_i \ln{p_i} + (1-y_i)\ln{...

1
2
3 4 5
48