# Proving the consistency of this OLS estimator for $\hat\beta_1$?

So in this particular linear regression model we are given that $$\beta_0=0$$.

The goal is to find the estimator, $$\hat\beta_1$$, and show that it is consistent.

I managed to find $$\hat\beta_1$$ as follows:

$$u_i=Y_i-\hat{Y}_i=Y_i-\hat{{\beta}_i}X_i$$

$$u_{i}^{2}=(Y_i-\hat{{\beta}_i}X_i)^2$$

$$\sum u_{i}^{2}=\sum (Y_i-\hat{{\beta}_i}X_i)^2$$

$$\frac{\delta \sum u_i^2}{\delta\hat{\beta_1}}=\frac{\delta \sum (Y_i-\hat{{\beta}_i}X_i)^2}{\delta\hat{\beta_1}} \leftarrow 0$$

$$\sum (-2X_i)(Y_i-X_i\hat\beta_1)=0$$

$$\sum X_iY_i-\hat\beta_1\sum X_i^2=0$$

$$\frac{\sum Y_i}{\sum X_i}=\hat\beta_1$$

To be consistent, I know that $$Pr(\left|\hat\beta_1-\beta_1\right| \leq c)=1$$ must be the case

Hence I get

$$Pr(\left|\frac{\sum Y_i}{\sum X_i} - \frac{Y_i}{X_i}\right| \leq c)=1$$ must be the case.

This is where I am stuck. How do I go from here to show that the estimator is consistent?

Is this even the right approach to begin with? Thanks.

• You solved incorrectly for $\hat\beta_1$. Commented Jul 10, 2020 at 5:54

The condition for consistency is actually $$\Pr\left(\left|\frac{\sum_i Y_i}{\sum_i X_i}-\beta_1\right|>c\right)\to 1$$

That is, it's $$\beta_1$$ that the ratio needs to be close to, and the probability needs to be 1 only asymptotically. Also, it's relatively unusual that you need to prove consistency directly in that way; usually you can show your statistic is made up of pieces that you know are consistent and argue that the whole thing is consistent.

Instead of sums in the fraction defining $$\hat\beta_1$$, think of means $$\hat\beta_1 = \frac{\frac{1}{n}\sum_i Y_i}{\frac{1}{n}\sum_i X_i}$$ That's the same, since the $$n$$s cancel from the top and bottom, but we have the Law of Large Numbers for means.

As long as the distribution of $$Y|X$$ has a finite mean, the numerator converges in probability (or almost surely) to $$E[Y]$$.

What happens with the denominator depends on what you're assuming about $$X$$. If $$X$$ are random, then the law of large numbers applies, and the denominator converges in probability (or almost surely) to $$E[X]$$.

So, the ratio converges to $$E[Y]/E[X]$$. According to the model, $$E[Y|X=x]=\beta_1 x$$, so $$E[Y]=E[E[Y|X=x]]=\beta_1E[X]$$, so $$E[Y]/E[X]=\beta_1$$ and we are done.

The OLS estimator in general case, with $$k$$ regressors and constant is $$\hat{\beta} = (X^{T}X)^{-1}X^{T}Y$$, where: $$X$$ is matrix with $$n$$ rows (observations), $$k+1$$ columns ($$k$$ regressors and first column of 1's), $$X^T$$ is its transposition and $$Y$$ stands for $$n\times 1$$ vector of realizations of dependent variable. In your case, this simplify to: $$\hat\beta_1 = \Bigg([X_{11},\ldots,X_{n1}]\begin{bmatrix} X_{11}\\X_{21}\\\vdots\\X_{n1}\end{bmatrix}\Bigg)^{-1}[X_{11},\ldots,X_{n1}]\begin{bmatrix}Y_{1}\\Y_2\\\vdots\\Y_n\end{bmatrix}=\frac{\sum_{i=1}^n X_{i1}Y_i}{\sum_{i=1}^{n}X_{i1}^2}\quad,$$ where first index stands for number of observations. In your formula is a mistake, because you reduced in bad way in fifth line. To obtain consistency, when we consider random $$X_1$$ and random sample from population ($$\{(X_{i1},Y_i) IID\mid i\in\{1,\ldots,n\}\}$$), we need to do some algebra: $$\frac{\sum_{i=1}^n X_{i1}Y_i}{\sum_{i=1}^{n}X_{i1}^2}=\frac{\sum_{i=1}^n X_{i1}(X_{i1}\beta_1+\mu_i)}{\sum_{i=1}^{n}X_{i1}^2}=\beta_1+\frac{\sum_{i=1}^n X_{i1}\mu_i}{\sum_{i=1}^{n}X_{i1}^2}=\beta_1+\frac{n^{-1}\sum_{i=1}^n X_{i1}\mu_i}{n^{-1}\sum_{i=1}^{n}X_{i1}^2}$$ If we assume, that $$\mathbb{E}[X_{1}\mu]=0$$ and $$\mathbb{E}[X_1^2]>0$$, then by Weak Law of Large Numbers our fraction is: $$\frac{n^{-1}\sum_{i=1}^n X_{i1}\mu_i}{n^{-1}\sum_{i=1}^{n}X_{i1}^2}\xrightarrow{P}0\quad.$$ We obtained weak consistency (our estimator converges in probability to the true value of the parameter).