Are these diagnostic plots from lmer too far away from normal and showing heteroscedasticity?

I have read similar posts in this website to help me assess whether my diagnostic plots are too far away from normal and if they are showing heteroscedasticity (Interpretation of residuals vs fitted plot, Interpretation of plot(glm.model)) and I researched other sources as well. I haven't been able to find plots that might resemble mine.

I have concerns about my residuals not having a normal distribution (qqplot) as they depart from the line quite a bit, but I am even more concerned about my data showing heteroscedasticity. Are my concerns well founded here?[1]

The plots belong to this linear mixed model with one random effect (individual id) and a fixed effect that is a three way interaction:

lmer(log.prop.out ~ 1 + time*season*sex + (1|id), REML=FALSE, data=in.out)


where log.prop.out is the log of a proportion, whereas time, season and sex are all categorical predictors. Should I be concerned about the log transformation not being enough to normalize my response variable?

I am struggling to decide how bad can these plots look without raising concern.

Thank you very much for your kind guidance!

Without the transformation, using directly the proportions, this is how the residuals vrs fitted plot looks like:

• Look at the right tail in the second plot. There's definitely something going on. Apr 29, 2016 at 12:38
• Thank you ssdecontrol, it did look to me like a funnel-shaped pattern that I have seen in other plots showing heteroscedasticity. I was unsure though about this one, as it did not look as bad as the examples I have seen before showing this pattern.
– AnnK
Apr 29, 2016 at 13:25
• What do the results look like without the log transformation? Apr 29, 2016 at 14:38
• I have edited my question to add the graph of how the residuals vrs fitted plot without the transformation. I don't know what other possibilities could there be for analyzing this data. I already tried: a) fitting the model with the untransformed variable, which results in the plot above and shows that the residual variance increases as fitted values increase, decreasing again at high fitted values;
– AnnK
Apr 30, 2016 at 22:04
• b) fitting the model with the log transformation; and c) using a GLMM with a binomial family. This last option resulted in a model with huge overdispersion! (Residual deviance = 9237.581 on 93 degrees of freedom and a ratio of: 99.329). Would you have any suggestions as to what other options I could try that might fit the data better? I don't have any additional covariates that I could incorporate to the model.
– AnnK
Apr 30, 2016 at 22:04