1
$\begingroup$

For the linear regression $y_t = Bx_t+e_t$ where we have the assumptions: $E(e_t)=0$, $E(e_t^2) = \sigma^2$, $E(e_t e_s)= 0$ for $s\neq t $ a ), suppose $x_t = \frac{1}{t}$ for all t. Is $\hat {B}$ unbiased an consistent or not?

b)Suppose $x_t = \frac{1}{2}$ for all t. Show whether $\hat{B}$ is unbiased or not. Show whether $\hat{B}$ is consistent for $\beta$ or not.

For point a I state that the estimator is unbiased because $$E(\hat{B}) = \beta + E\left(\sum_{t=1}^{T} \frac{1}{t}e_t\right) = \beta + \sum_{t=1}^{T} \frac{1}{t}E(e_t) = \beta$$ then I checked if the variance is equal to $0$ to verify consistency and : \begin{align*} Var(\hat{\beta}) &= Var\left(\frac{\sum_{t=1}^{T} \frac{1}{t}e_t}{\sum_{t=1}^{T} \frac{1}{t}^2}\right) \\ &= \frac{1}{\left(\sum_{t=1}^{T} \frac{1}{t^2}^2\right)} \cdot \sum_{t=1}^{T} \left(\frac{1}{t}\right)^2 Var(e_t) \\ &= \sigma^2 \cdot \frac{1}{\sum_{t=1}^{T} \frac{1}{t}^2} \end{align*}

Since the denominator is finite then the variance does not converge to $0$ because $\sum_{t=1}^T \frac{1}{t^2}\lt \infty$ then the $\hat{B}$ is not consistent Is my attempt correct?

for point B I state that the estimator is unbiased for the same reason of point. How can I show if the $\hat{B}$ is consistent or not in this case?

Any help would be really appreciated

$\endgroup$
3
  • $\begingroup$ What, exactly, is your definition of a "consistent" estimator? The setting of (a) does not conform with most of the definitions I have seen: there is no sequence of independent samples of a distribution in evidence. As far as (b) goes, that looks easier than (a) (but beware the typographical errors in your account of (a) -- maybe they are more than typographical?). What is the obstacle to performing the same kind of analysis? $\endgroup$
    – whuber
    Jul 5 at 19:31
  • $\begingroup$ for consistency I mean $\hat{B}$ goes in probability to $\beta$. I do not know how to prove this. I tried to demonstrate what happens when T goes to infinity for variance showing mean-square error convergence because I think should also imply convergence in probability, maybe this is not the correct approach $\endgroup$
    – WNZ
    Jul 6 at 7:18
  • $\begingroup$ Consider comparing $(1/1)e_1,$ with a variance of $\sigma^2,$ to $\sum_{t=2}^T (1/t)e_t,$ with a variance not exceeding $(\zeta(2)-1)\sigma^2\approx 0.645\sigma^2.$ What does this reveal about the distribution of $\hat\beta$? $\endgroup$
    – whuber
    Jul 6 at 13:20

1 Answer 1

1
$\begingroup$

Since there are situations where an estimator satisfies the criterion for asymptotic consistency, but still has a non-zero variance at the limit (look around this site to find relevant discussions, e.g. Asymptotic consistency with non-zero asymptotic variance - what does it represent?),

one would want to examine directly the probability at the heart of the asymptotic consistency criterion.

For $\hat \beta_T$ to be consistent we would want

$$\Pr\left(|\hat \beta_T - \beta| > \epsilon\right) \to 0, \;\;\; \forall \epsilon >0.$$

Now,

$$\Pr\left(|\hat \beta_T - \beta| > \epsilon\right) = \Pr\left(\frac{\left|\sum_{t=1}^{T} \frac{1}{t}e_t\right|}{\sum_{t=1}^{T} \frac{1}{t^2}} > \epsilon\right)$$

and because, indeed, the denominator converges (to $\pi^2/6$) as $T\to \infty$, the issue is what happens with $$\left|\sum_{t=1}^{T} \frac{1}{t}e_t \right|\;\;\; {\rm as} \;\;\; T\to \infty.$$

We would want it to go to zero. Because $$ \sum_{t=1}^{T} \frac{1}{t}e_t \leq \left|\sum_{t=1}^{T} \frac{1}{t}e_t \right|,$$

we can ignore the absolute value. Now, assuming that the $e_t$ random variables are independent, and since $1/t$ is deterministic and $E(e_t) = 0$ we have,

$$E\left(\sum_{t=1}^{T} \frac{1}{t}e_t\right) = 0,\;\;\; {\rm Var}\left(\sum_{t=1}^{T} \frac{1}{t}e_t\right) = {\rm Var}(e_t)\sum_{t=1}^{T} \frac{1}{t^2} \to \frac{\pi^2}{6}{\rm Var}(e_t).$$

It appears that $\sum_{t=1}^{T} (e_t/t)$ converges to a regular random variable, meaning that its absolute value does not go to zero. So the probability criterion for asymptotic consistency for $\hat \beta_T$ is not satisfied.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.