I need to prove that $X^T e$ = 0 where $e$ is the residual in multiple linear regression model in matrix algebra?

I need some guidance on how to do it. Is there any good pdf for the proofs for multiple linear regression model for matrix alegbra?


$$\mathbf X'\mathbf e = \mathbf X'(\mathbf y -\mathbf {\hat y})= \mathbf X'(\mathbf y -\mathbf X\hat \beta) =...$$


$$=\mathbf X'\left(\mathbf y -\mathbf X (\mathbf X'\mathbf X)^{-1}\mathbf X' \mathbf y\right) =\mathbf X'\mathbf y -\mathbf X'\mathbf X (\mathbf X'\mathbf X)^{-1}\mathbf X' \mathbf y$$

$$\mathbf X'\mathbf y -\mathbf X' \mathbf y = \mathbf 0$$

  • 3
    $\begingroup$ could you kindly finish the proof? $\endgroup$ – Siddharth Gopi Oct 31 '13 at 7:19
  • 2
    $\begingroup$ I support @garciaj. Answers are not a place for hints or haze, even transparent. Reserve those for comments, please. $\endgroup$ – ttnphns Oct 31 '13 at 9:25
  • 1
    $\begingroup$ @ttnphns I disagree: "hint-answers" can be the appropriate response when the OP just asks for a hint ("need some guidance", the OP wrote), or when the OP doesn't, but the question is related to homework/self-study. But now that the OP indicated that the hint-answer has covered the OP's needs, I am completing it so that the answer stands on its own. $\endgroup$ – Alecos Papadopoulos Oct 31 '13 at 9:49
  • 5
    $\begingroup$ You would be right if it were a cabinet conversation between you and the OP. But this site is being seen by many frequenters and passers-by who would be bewildered by an interrupted response. Once again: if you want to stop at a hint level, please do it as a comment, not an answer. $\endgroup$ – ttnphns Oct 31 '13 at 10:11
  • 2
    $\begingroup$ @ttnphns Once again: I disagree. This site is both a conversation between the OP and the answerer, and a public place where people come to find ready-made complete Q&A - so we should always try to find ways to service both...which is what I did with the way I structured my answer. And in general, my answers tend to be rather ...over-complete. $\endgroup$ – Alecos Papadopoulos Oct 31 '13 at 10:21

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.