5
$\begingroup$

I have conducted a linear regression analysis with four variables. The response, say $\#$ of eggs per 2000 hens, and one of the predictors, say temperature change, are highly skewed. I have hence transformed these two to $\log (\sqrt{x^{2}+1}+x)$ when values are zero or positive, and $-\log (\sqrt{x^{2}+1}-x)$ when values are negative. Additionally, I have standardized the three predictors, but not the response variable. I need help with the following:

1) How do I interpret the coefficients, if for example $b_1$ (of transformed predictor) is 0.385 and $b_2$ (predictor is in natural form) is 0.102?

2) The coefficient and t-value of $b_0$ are very high compared with the betas and t-values of $b_1$, $b_2$ and $b_3$. Does this suggest problems with my model?

$\endgroup$
3
  • $\begingroup$ @Learner I don't think so; the issues raised here are mostly different. $\endgroup$
    – Nick Cox
    Jun 18, 2015 at 9:40
  • 3
    $\begingroup$ What was the motivation to transform the predictors in the first place? There are no assumptions whatsoever associated with the raw predictor variables in linear regression. Further, as your response is a count variable, you may want to look into Poisson regression. $\endgroup$ Jun 18, 2015 at 9:40
  • $\begingroup$ A separate comment is that if you really did put temperature change and its transform in the model at the same time, then that will really produce a mess. It's one or the other but not both. $\endgroup$
    – Nick Cox
    Jun 18, 2015 at 14:38

1 Answer 1

15
$\begingroup$

I agree strongly with the suggestion of COOLSerdash and Srikanth Guhan that Poisson regression is much more natural for your problem. So the idea of transforming the response is a much weaker solution than using an appropriate count model. Poisson regression is well documented in many good texts and in this forum. In effect you get treatment on a logarithmic scale but with smart ideas ensuring that zeros in your data don't bite. (If Poisson regression turns out to be an over-simplification, there are models beyond.)

The rest of this answer focuses on the transformation you have used and whether it is a good idea for temperature change as a predictor that can be negative, zero or positive. This is a more unusual question by far.

The transformation used here has a name, asinh or inverse hyperbolic sine. Its graph is nicer than its algebraic definition in the question using other functions more likely to be met in elementary mathematics:

enter image description here

The function is defined for all finite values of an argument, $x$ say. I've plotted it arbitrarily over the range from $x = -10$ to $10$, except that that range has your example in mind to the extent possible; we'll get to that in a moment.

The virtues of this transformation include treating positive and negative values symmetrically. The result of the transformation varies smoothly as the argument passes through zero. It will certainly pull in outliers that are large positive or large negative. It is likely to reduce skewness in many cases.

Another virtue of the transformation is that it is close to the identity transformation for values near zero. The graph shows a line of equality near the origin to underline this point. (All puns should be considered intentional.)

Against all that I would want to underline reservations about using this transformation.

First, but not least, even if people have met this transformation in a previous existence, I doubt that many people retain a good feeling for what it is and how it works. To be personal about this, I meet it in statistical practice about once every three years and have to draw the graph and think about it every time. Unless you are working in an area where it is a known trick, most readers are going to say "What's that?" in some way or another. That doesn't rule it out as a solution, but it's a practical consideration when imagining putting this in a paper or thesis.

Second, and more important, I doubt there is any biological (physical, economic, whatever) rationale to this. It's unphysical and unphysiological, I would guess wildly, to imagine that temperature change works in this way in affecting organisms. We do some things in statistics for purely statistical reasons, naturally, but it is a bonus when that makes sense scientifically, and not otherwise.

Third, something you should certainly do is plot asinh(temperature change) versus temperature change for your data and ask how much difference it really makes. As pointed out, the transformation is close to identity for small $x$: the important part of that is being close to linear for small $x$. The scatter plot equivalent of my graph for your data points may indicate that you are better off leaving the data as they are. How does the skewness arise? Is a matter of a few outliers? I will now reveal that my limits from $-10$ to $10$ arise from a(nother wild) guess that most of your temperature changes will be small, a few $^\circ$C. (What is temperature change any way? Day to day? Really big temperature changes might just kill the hens, or put them off egg laying altogether; perhaps that is part of your problem.) So: one possibility is that the transformation makes less difference than you imagine, in which case not doing it would simplify your analysis. Another possibility is that there is a real problem here which might need to be dealt with in other ways. We would need to hear more about your data to advise better.

Fourth, and perhaps most important, is that the marginal distribution of any predictor is not itself important for regression models, contrary to many myths recycled repeatedly.

Fifth, plotting residuals versus predictor is a (partial) way to see whether the version of the predictor used actually works well in your model. Pattern on this plot may indicate that you got it wrong. (By "version of", I mean temperature change, or its asinh, or some other transformation.)

I don't see much need for or merit in standardisation of predictors here.

In seeking better advice, posting your data as well makes it much easier to advise.

EDIT 3 Sept 2021 "To be personal about this" Since this was written I have seen asinh in action more and played with the definition and its derivative in relation to data. Hence I know better how and when it works, or helps. That's trivial, but also universal: If something is unfamiliar, you may have to work at it before it becomes familiar.

$\endgroup$
3
  • 1
    $\begingroup$ (+1) Very thorough and informative answer. Additional interesting resources regarding the inverse hyperbolic sine transformation: Paper by Burbidge et al., post one, post two. $\endgroup$ Jun 18, 2015 at 10:44
  • $\begingroup$ +1 Great advice. The IHS is a kind of logarithm for both positive and negative values, blending $\log(x)$ with $-\log(-x)$ to create a symmetric one-to-one transformation of the reals to themselves. The blending works by shifting the graph of the logarithm (with which we are all very familiar) at the point $x$ to the left by $1/x$. For large $x$--essentially $x\gg 3$--the shift scarcely changes the graph, while for small $x$ between $1$ and $3$ it is made to pass through the origin. It is rescaled to make a unit slope at the origin. See this plot. $\endgroup$
    – whuber
    Jun 18, 2015 at 12:20
  • $\begingroup$ Very informative advice, thanks. I will explore the Poisson framework and then make a comparison of the outcomes. $\endgroup$ Jun 18, 2015 at 18:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.