Skip to main content
edited tags and added description of most recent attempt
Source Link
liqiudilk
  • 133
  • 1
  • 4

To quote:

It is well known that, if $W_1, ..., W_n, Z_1, ..., Z_m$ are random variables and $a_1, ..., a_n, b_1, ..., b_m$ are constants, then

$Cov ( \sum_{i=1}^n a_iW_i, \sum_{j=1}^m b_jZ_j) = \sum_{i=1}^n \sum_{j=1}^m a_i b_j Cov(W_i,Z_j)$.

Use this property (and other properties of covariance) to prove that for the model $Y_i = \alpha + \beta x + \epsilon$, with $\epsilon \sim N(0,\sigma^2)$, we have $Cov(\hat{\beta},\bar{Y}) = 0 $,

where $\hat{\beta} = S_{XY}/S_{XX}$.


Currently my most successful attempt was to try to put $S_{XY} \over S_{XX}$ as $\sum_i (x_i - \bar{x})(Y_i - \bar{Y}) \over \sum_i (x_i - \bar{x})(x_i - \bar{x})$ then substituting $Y = \alpha + \beta x + \epsilon$, but even in this best attempt I just end up with a mess and a stray epsilon I can't deal with (one reduces to 0 though the summing to get $\bar{Y}$, but the other ends up as a nasty coefficient).

I'm really not sure what to do.

Edit: Added a run down on some previous issues and the self-study tag.

To quote:

It is well known that, if $W_1, ..., W_n, Z_1, ..., Z_m$ are random variables and $a_1, ..., a_n, b_1, ..., b_m$ are constants, then

$Cov ( \sum_{i=1}^n a_iW_i, \sum_{j=1}^m b_jZ_j) = \sum_{i=1}^n \sum_{j=1}^m a_i b_j Cov(W_i,Z_j)$.

Use this property (and other properties of covariance) to prove that for the model $Y_i = \alpha + \beta x + \epsilon$, with $\epsilon \sim N(0,\sigma^2)$, we have $Cov(\hat{\beta},\bar{Y}) = 0 $,

where $\hat{\beta} = S_{XY}/S_{XX}$.

To quote:

It is well known that, if $W_1, ..., W_n, Z_1, ..., Z_m$ are random variables and $a_1, ..., a_n, b_1, ..., b_m$ are constants, then

$Cov ( \sum_{i=1}^n a_iW_i, \sum_{j=1}^m b_jZ_j) = \sum_{i=1}^n \sum_{j=1}^m a_i b_j Cov(W_i,Z_j)$.

Use this property (and other properties of covariance) to prove that for the model $Y_i = \alpha + \beta x + \epsilon$, with $\epsilon \sim N(0,\sigma^2)$, we have $Cov(\hat{\beta},\bar{Y}) = 0 $,

where $\hat{\beta} = S_{XY}/S_{XX}$.


Currently my most successful attempt was to try to put $S_{XY} \over S_{XX}$ as $\sum_i (x_i - \bar{x})(Y_i - \bar{Y}) \over \sum_i (x_i - \bar{x})(x_i - \bar{x})$ then substituting $Y = \alpha + \beta x + \epsilon$, but even in this best attempt I just end up with a mess and a stray epsilon I can't deal with (one reduces to 0 though the summing to get $\bar{Y}$, but the other ends up as a nasty coefficient).

I'm really not sure what to do.

Edit: Added a run down on some previous issues and the self-study tag.

edited tags
Link
liqiudilk
  • 133
  • 1
  • 4
Source Link
liqiudilk
  • 133
  • 1
  • 4

How to prove that $Cov(\hat{\beta},\bar{Y}) = 0 $ using given covarience properties

To quote:

It is well known that, if $W_1, ..., W_n, Z_1, ..., Z_m$ are random variables and $a_1, ..., a_n, b_1, ..., b_m$ are constants, then

$Cov ( \sum_{i=1}^n a_iW_i, \sum_{j=1}^m b_jZ_j) = \sum_{i=1}^n \sum_{j=1}^m a_i b_j Cov(W_i,Z_j)$.

Use this property (and other properties of covariance) to prove that for the model $Y_i = \alpha + \beta x + \epsilon$, with $\epsilon \sim N(0,\sigma^2)$, we have $Cov(\hat{\beta},\bar{Y}) = 0 $,

where $\hat{\beta} = S_{XY}/S_{XX}$.