14
$\begingroup$

In general, I'm wondering if there it is ever better not to use orthogonal polynomials when fitting a regression with higher order variables. In particular, I'm wondering with the use of R:

If poly() with raw = FALSE produces the same fitted values as poly() with raw = TRUE, and poly with raw = FALSE solves some of the problems associated with polynomial regressions, then should poly() with raw = FALSE always be used for fitting polynomial regressions? In what circumstances would it be better not to use poly()?

$\endgroup$

2 Answers 2

17
$\begingroup$

Ever a reason? Sure; likely several.

Consider, for example, where I am interested in the values of the raw coefficients (say to compare them with hypothesized values), and collinearity isn't a particular problem. It's pretty much the same reason why I often don't mean center in ordinary linear regression (which is the linear orthogonal polynomial)

They're not things you can't deal with via orthogonal polynomials; it's more a matter of convenience, but convenience is a big reason why I do a lot of things.

That said, I lean toward orthogonal polynomials in many cases while fitting polynomials, since they do have some distinct benefits.

$\endgroup$
4
  • $\begingroup$ is it possible to compare the coefficients resulting from an orthogonal polynomial regression to hypothesized values? $\endgroup$ Jun 20, 2014 at 4:55
  • 2
    $\begingroup$ Yes. You can transform them back to the implied coefficients and standard errors from the "raw" polynomials, for example. $\endgroup$
    – Glen_b
    Jun 20, 2014 at 5:03
  • 3
    $\begingroup$ More often than not, converting from the orthogonal polynomial basis to the monomial basis is an ill-conditioned process (for high degrees; low-degree conversion is not too bad), so if one is a priori interested in the monomial basis coefficients, any numerical stability you gained from using the orthogonal polynomials is thrown out the window at conversion, so you might as well use monomials at the outset. Caveat emptor, of course. $\endgroup$ Jan 27, 2017 at 15:07
  • 2
    $\begingroup$ @J.M. Thanks, that's an excellent point. Fortunately it would be very rare in statistical applications these days to fit more than a fairly low order polynomial (my usual advice is that unless there's a strong theoretical reason to go above degree three or four, one should look at different approaches -- which alternative might be best depends on the circumstances, but things like splines, for example, may be suitable for some situations.). $\endgroup$
    – Glen_b
    Jan 27, 2017 at 23:41
15
$\begingroup$

Because if your model leaves R when it grows up, you have to remember to pack its centring & normalization constants, & then it has to lug them around the whole time. Imagine coming across it one day hard-coded into SQL, & the horror of realizing it's mislaid them!

$\endgroup$
0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.