0
$\begingroup$

I want to show an inverted U-shape relationship between two variables: "minutes spent in a room A" and "trustworthiness in others". The hypothesis is that those who have low and high trustworthiness are the ones who spend the least amount of time in room A, whereas those with medium level-trustworthiness spend the most time in that room. The inverted U shape relationship is visible when I plot the two variables (x=trustworthiness and y=minutes spent in a room A).

To statisitcally test this inverted U-shape, I calculated a polynomial regression in R using the poly function. I have been reading about the different arguements that the function can have, depending on whether the linear and quadratic regressor should be considered as orthogonal or raw regressors.

The output for the "raw" polynomial regression is as follows: enter image description here

The output for the "orthogonal" polynomial regression is as follows: enter image description here

Now, reading through questions (and answers) of others, in my model, the linear and quadratic regressors seem to be highly correlated as the raw and orthogonal output is vastly different considering their own p-values and beta-weights. I would interpret that in the "raw" model, both predictors are significant but not on their own, their significance is dependent on both regressors being in the model (because they are strongly correlated, (actually r = 0.94)). In the "orthogonal" model, the regressors are considered independently. Therefore one could conclude that the orthogonal model is the right choice and the result shows that the relationship can be significantly described by a quadratic fit, rather than a linear fit, so a U-shape relationship seems fair. (note: calculating the linear fit along (lm(y~x)) results in an insignificant fit with an Rsuared under 1%, whereas in the polynomial fits, it goes up to 18% - which is still not fantastic, but still better).

However, when interpreting the beta-weights, I would still need to use the coefficients from the raw model in order to make sensible predictions. So if one cannot interpret the beta-weights in the orthogonal models because in fact the two regressors are inherently correlated, can the above conclusion about better fit really be made?

ps. the QQ plots for the residuals as well as the normality checks using Shapiro-Wilk indicate that the prerequisits for the regression model are met

$\endgroup$

1 Answer 1

0
$\begingroup$

A polynomial term in a regression represents the product of a continuous predictor with itself. It's just one form of an interaction term in a regression, which in general is the product of two predictors.

You should be very cautious about interpreting individual coefficients when predictors are involved in interactions. The value of an individual coefficient for a predictor involved in an interaction depends on the coding of the predictor(s) with which it interacts. Thus, for a predictor involved in an interaction, the apparent "significance" of its individual coefficient (whether it differs from 0, which is what the p-value reports) is a function of the way the interacting predictors are coded. In this case, the coding differs between the choice for raw. To evaluate the significance of such a predictor, you need to include all of the terms that involve the predictor, for example in a likelihood-ratio test or a multi-coefficient Wald test.

However you code the predictor, the model will still provide the same predictions about outcome. The intercept and the linear terms in your two models differ due to the reasons explained above, but the models are identical in terms of fitting the data and any predictions you would make from them. Don't waste time fretting about the "significance" of its individual coefficient.

One further suggestion: a polynomial fit imposes a strong structure over the shape of the predictor-outcome relationship. You might consider a more flexible fit, for example with a regression spline.

$\endgroup$
2
  • $\begingroup$ Thank you for your input and suggestions. As you have stated, however I code the predictors, the model itself has the same outcome. I understand from your answer that I should not interpret the individual coefficients (or if I do, I should think about likelihood-ratio tests or multi-coefficient Wald tests). But since the over all polynomial model is significant eitherway, can I make the statement that for this data, there is a significant quadratic fit (or: an inverted U-shape fit) which can explain about 18% of the variance in the data? $\endgroup$
    – nina_stats
    Apr 20 at 8:06
  • $\begingroup$ @nina_stats the overall fit explains about 18% of the variance, based on the adjusted R-squared (which includes a correction for the number of coefficients estimated), but that includes the linear part of the fit too. The quadratic term is highly significant statistically (p = 0.0014) but that doesn't directly say how much of the variance is explained by the quadratic term itself. You could compare models with and without the quadratic term. $\endgroup$
    – EdM
    Apr 20 at 17:24

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.