Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

I have large survey data, a binary outcome variable and many explanatory variables including binary and continuous. I am building model sets (experimenting with both GLM and mixed GLM) and using information theoretic approaches to select the top model. I carefully examined the explanatories (both continuous and categorical) for correlations and I am only using those in the same model that have a Pearson or Phicorr coeff less than 0.3. I would like to give all of my continuous variables a fair chance in competing for the top model. In my experience, transforming those that need it based on skew improves the model they participate in (lower AIC).

My first question is: is this improvement because transformation improves the linearity with the logit? Or is correcting skew improves the balance of the explanatory variables somehow by making the data more symmetric? I wish I understood the mathematical reasons behind this but for now, if someone could explain this in easy terms, that would be great. If you have any references I could use, I would really appreciate it.

Many internet sites say that because normality is not an assumption in binary logistic regression, do not transform the variables. But I feel that by not transforming my variables I leave some at disadvantage compared to others and it might affect what the top model is and changes the inference (well, it usually does not, but in some datasets it does). Some of my variables perform better when log transformed, some when squared (different direction of skew) and some untransformed.

Would someone be able to give me a guideline what to be careful about when transforming explanatory variables for logistic regression and if not to do it, why not?

share|improve this question
    
Welcome to the site! I removed your signature line because the site adds it automatically. –  Peter Flom Oct 4 '12 at 16:31
2  
Indeed, in logistic regression there is no assumption of normallity (or logistic distribution in this case). The link function $F$ (sometimes denoted $F^{-1}$) is used for modelling the relationship between the probability of observing a $1$ ($0$) with the covariates through $P(Y=1\vert \beta, X)=F(X\beta)$. A poor fit/performance may be due to the choice of the link function. An alternative for sorting this issue consists of using a more flexible distribution, see for example this paper. –  user10525 Oct 4 '12 at 16:45

1 Answer 1

You should be wary of decide about transforming or not the variables just on statistical grounds. You must look on interpretation. ¿Is it reasonable that your responses is linear in $x$? or is it more probably linear in $\log(x)$? And to discuss that, we need to know your varaibles... Just as an example: independent of model fit, I wouldn't believe mortality to be a linear function of age!

Since you say you have "large data", you could look into splines, to let the data speak about transformations ... for instance, package mgcv in R. But even using such technology (or other methodsto search for transformations automatically), the ultimate test is to ask yourselves what makes scientific sense. ¿What do other people in your field do with similar data?

share|improve this answer
    
Thanks for supporting my worries: indeed, I have though about what makes biological sense. The problem is, that I actually have two related datasets and I would like to draw conclusions from both at the same time. But in one subset, the density variable is best in the models untransformed while in the other log transformation is the best. Log transformation improves the relationship in the dataset that has the lower values for that variable, so it will be very difficult to reconcile these two datasets I think, unless I leave the variable untransformed in both. –  Zsuzsa Oct 10 '12 at 18:51

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.