I am new to linear regression and came across the following paper when looking for examples to practice: https://www.maths.cam.ac.uk/sites/www.maths.cam.ac.uk/files/pre2014/postgrad/mathiii/pastpapers/2012/PaperIII_37.pdf
I feel as though I would benefit from a model write-up for part (d) of the first question. In particular, what does the difference in slopes in models 1 and 2 tell us?
To address specific points in the earlier parts of the question, I assume that the command ‘I(height-165)’ subtracts the fixed value of 165 cm from each of the sample observations for height. The purpose of this procedure is to center the data around a mean height, so that we may give a physical interpretation to the intercept (but is there another reason for this?). In the context of this question, the intercept is the weight of a student of height 165 cm.
My attempt for part (d) is as follows:
The F-test performed for each of the three models has a very small p-value, indicating that there is at least one non-zero coefficient in each model. The R-squared values indicate a weak to moderate strength in the relationship between predictor and corrector for each of the three models. The p-value for each of the individual coefficients is less than 0.05, with the exception of the interaction term in model 3 (=0.73139, where the interaction is between sex and centralised height). This suggests that this predictor can be removed from the third model as it is of no statistical significance (in terms of hypothesis tests, we fail to reject H0 in the t-test for that coefficient). Omitting this predictor gives us model 2, which seems the most preferable (higher R^2 value than the first model and lower p-value for the F-test).
What seems quite puzzling is that we have a relatively large standard error for the estimate of the 'sex' coefficient in the second model. This would suggest that the coefficient isn't well estimated by the model.
As for part (e), under the assumption that the residuals are Gaussian with mean 0, I would expect the maximum and minimum residuals to be evenly spaced from 0. In this case, the maximum is more than three standard errors from 0 in every model.
For part (e), is the above what the question is looking for and what should be suggested to the nutritionist in light of this data?
The only answer I can think of is that the assumption that the errors are Gaussian is not met and the linear model may not be appropriate.
Any answers to the above highlighted questions are very much appreciated.