7
$\begingroup$

In Discovering Statistics using SPSS 4th Edition by Andy Field, it was recommend to include the interaction term between the independent variable $x$ and its corresponding natural logarithm transform $\ln(x)$ variable to check for violation of the linearity assumption. What is the statistical theory behind this?

This a quote from the book:

This assumption can be tested by looking at whether the interaction term between the predictor and its log transformation is significant (Hosmer & Lemeshow, 1989).

I've also recently found out that this transformation is called Box-Tidwell transformation.

$\endgroup$
  • 2
    $\begingroup$ I recall that book giving dubious advice from another question here: stats.stackexchange.com/questions/157217/…. This include x ln(x) also strikes me as also dubious. $\endgroup$ – Matthew Drury Jun 6 '16 at 4:07
  • 4
    $\begingroup$ tatami There may well be a good reason for it, but context will probably help locate it more quickly. What basis did Field use to suggest it was a good idea? Did he offer any references? Can you quote what the book says? $\endgroup$ – Glen_b Jun 6 '16 at 4:48
  • 1
    $\begingroup$ A better way (given enough data) might be to use a logistic GAM (generalized additive model) and include a spline fit of x. $\endgroup$ – kjetil b halvorsen Jun 6 '16 at 9:36
  • $\begingroup$ @Glen_b I've added a quote from Andy Field's book $\endgroup$ – tatami Jun 6 '16 at 12:55
  • $\begingroup$ New to me, but seems to make sense for a particular kind of non-linearity: stats.uwo.ca/faculty/braun/ss3859/notes/Chapter6/ch5notes.pdf $\endgroup$ – Scortchi Jun 6 '16 at 13:04
14
$\begingroup$

Box and Tidwell (1962) presented a somewhat general approach for estimating transformations of the individual predictors (IVs), and work through the specific case of estimating power transformations of the predictor variables (including that power 0, which - with appropriate scaling - corresponds to taking logs as a limiting case).

In that particular case of power transformations, it turns out that there's a connection to regressing on $X_j\log(X_j)$.

So if you have nonlinearity of the kind where the true (conditional) relationship between $Y$ and $X_j$ is linear in $X_j^{\alpha_j}$ then it can be used to check for $\alpha_j\neq 1$, or indeed to estimate $\alpha$ values.

Specifically, when regressing on $X_j$ and $X_j\log(X_j)$ the coefficient of the second term divided by that of the first is an approximate estimate of $\alpha_j-1$. (This estimate can be iterated to convergence.)

If that estimated $\alpha_j$ is close to 1 then there's little indication of a need to transform.

Note that since the two terms in the product $X_j\log(X_j)$ are both functions of $X_j$, this is simply a transformed $X_j$ so I wouldn't call that an interaction; it's just a transformed predictor. (Indeed, even if I were somehow tempted to do so, since $\log(X_j)$ is not included as a predictor I still wouldn't tend to describe that second term as an interaction.)

Box, G. E. P. and Tidwell, P. W. (1962) Transformation of the independent variables. Technometrics 4, 531-550.

$\endgroup$
  • 1
    $\begingroup$ Maybe this has some limited value, especially if one has reason to expect nonlinearity of that specific power form, or if one is forced to use software which does not offer more modern alternatives, such as using a GAM (generalized additive model), effectively estimating the nonlinearity directly with splines. Or, if thwe number of observations is to low to permit use of splines. $\endgroup$ – kjetil b halvorsen Jun 9 '16 at 7:52

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.