Skip to main content
added 330 characters in body; added 6 characters in body
Source Link
user28
user28

There is a constraint imposed a few lines above the highlighted text which states:

$\sum_i{v_i (d-kv_i)} = 0$$\sum_i{v_i (d_i-k v_i)} = 0$

Does the that help?

Edit

In response to your second comment:

The idea isConsider: $\sum_i{(d_i - l v_i)^2}$. This can be re-written as:

$\sum_i{((d_i - k v_i) + (k v_i - l v_i))^2}$

Expanding the following insightsquare, we have: Suppose that

$\sum_i{(d_i - k v_i)^2 + \sum_i(k v_i - l v_i)^2 + \sum_i{2 (d_i - k v_i) (k v_i - l v_i)}}$

Simplifying the above, we have:

$\sum_i{(d_i - k v_i)^2 + (k-l)^2 \sum_i{v_i^2} + 2 (k-l) \sum_i{v_i (d_i - k v_i)}}$

So, if we choose $k$ such that the above constraint is satisfied$\sum_i{v_i (d_i-k v_i)} = 0$ then it immediately follows that:

$\sum_i{(d_i - lv_i)^2} = \sum_i{(d-kv_i)^2} + (k-l)^2 \sum_i{v_i^2}$$\sum_i{(d_i - l v_i)^2} = \sum_i{(d_i - k v_i)^2} + (k-l)^2 \sum_i{v_i^2}$

But, then it follows that:

$\sum_i{(d_i - lv_i)^2} > \sum_i{(d-kv_i)^2}$$\sum_i{(d_i - l v_i)^2} > \sum_i{(d_i - k v_i)^2}$

as long as $k \ne l$.

Thus, what we have shown is the following: If $k$ satisfies the constraint we imposed then it must be the case that the corresponding SSE is less than the SSE for any other $l$ that we can choose. Thus, the value of $k$ that satisfies the constraint is our least squares estimate.

There is a constraint imposed a few lines above the highlighted text which states:

$\sum_i{v_i (d-kv_i)} = 0$

Does the that help?

Edit

In response to your comment:

The idea is the following insight: Suppose that we choose $k$ such that the above constraint is satisfied then it immediately follows that:

$\sum_i{(d_i - lv_i)^2} = \sum_i{(d-kv_i)^2} + (k-l)^2 \sum_i{v_i^2}$

But, then it follows that:

$\sum_i{(d_i - lv_i)^2} > \sum_i{(d-kv_i)^2}$

as long as $k \ne l$.

Thus, what we have shown is the following: If $k$ satisfies the constraint we imposed then it must be the case that the corresponding SSE is less than the SSE for any other $l$ that we can choose. Thus, the value of $k$ that satisfies the constraint is our least squares estimate.

There is a constraint imposed a few lines above the highlighted text which states:

$\sum_i{v_i (d_i-k v_i)} = 0$

Does the that help?

Edit

In response to your second comment:

Consider: $\sum_i{(d_i - l v_i)^2}$. This can be re-written as:

$\sum_i{((d_i - k v_i) + (k v_i - l v_i))^2}$

Expanding the square, we have:

$\sum_i{(d_i - k v_i)^2 + \sum_i(k v_i - l v_i)^2 + \sum_i{2 (d_i - k v_i) (k v_i - l v_i)}}$

Simplifying the above, we have:

$\sum_i{(d_i - k v_i)^2 + (k-l)^2 \sum_i{v_i^2} + 2 (k-l) \sum_i{v_i (d_i - k v_i)}}$

So, if we choose $k$ such that $\sum_i{v_i (d_i-k v_i)} = 0$ then it follows that:

$\sum_i{(d_i - l v_i)^2} = \sum_i{(d_i - k v_i)^2} + (k-l)^2 \sum_i{v_i^2}$

But, then it follows that:

$\sum_i{(d_i - l v_i)^2} > \sum_i{(d_i - k v_i)^2}$

as long as $k \ne l$.

Thus, what we have shown is the following: If $k$ satisfies the constraint we imposed then it must be the case that the corresponding SSE is less than the SSE for any other $l$ that we can choose. Thus, the value of $k$ that satisfies the constraint is our least squares estimate.

added 656 characters in body
Source Link
user28
user28

There is a constraint imposed a few lines above the highlighted text which states:

$\sum_i{v_i (d-kv_i)} = 0$

Does the that help?

Edit

In response to your comment:

The idea is the following insight: Suppose that we choose $k$ such that the above constraint is satisfied then it immediately follows that:

$\sum_i{(d_i - lv_i)^2} = \sum_i{(d-kv_i)^2} + (k-l)^2 \sum_i{v_i^2}$

But, then it follows that:

$\sum_i{(d_i - lv_i)^2} > \sum_i{(d-kv_i)^2}$

as long as $k \ne l$.

Thus, what we have shown is the following: If $k$ satisfies the constraint we imposed then it must be the case that the corresponding SSE is less than the SSE for any other $l$ that we can choose. Thus, the value of $k$ that satisfies the constraint is our least squares estimate.

There is a constraint imposed a few lines above the highlighted text which states:

$\sum_i{v_i (d-kv_i)} = 0$

Does that help?

There is a constraint imposed a few lines above the highlighted text which states:

$\sum_i{v_i (d-kv_i)} = 0$

Does the that help?

Edit

In response to your comment:

The idea is the following insight: Suppose that we choose $k$ such that the above constraint is satisfied then it immediately follows that:

$\sum_i{(d_i - lv_i)^2} = \sum_i{(d-kv_i)^2} + (k-l)^2 \sum_i{v_i^2}$

But, then it follows that:

$\sum_i{(d_i - lv_i)^2} > \sum_i{(d-kv_i)^2}$

as long as $k \ne l$.

Thus, what we have shown is the following: If $k$ satisfies the constraint we imposed then it must be the case that the corresponding SSE is less than the SSE for any other $l$ that we can choose. Thus, the value of $k$ that satisfies the constraint is our least squares estimate.

Source Link
user28
user28

There is a constraint imposed a few lines above the highlighted text which states:

$\sum_i{v_i (d-kv_i)} = 0$

Does that help?