2
$\begingroup$

Let $X_{1},X_{2},\ldots,X_{n}$ be a random sample whose distribution is given by $\text{Beta}(\theta,1)$. Obtain the approximate confidence interval of $100(1-\alpha)\%$ based on the asymptotic distribution of the score function.

MY ATTMEPT

In the first place, observe that the probability density function of $\text{Beta}(\theta,1)$ is given by $f(x|\theta) = \theta x^{\theta-1}$. Consequently, the Fischer information of the parameter $\theta$ is given by

\begin{align*} & f(x|\theta) = \theta x^{\theta-1} \Rightarrow \ln f(x|\theta) = \ln(\theta) + (\theta - 1)\ln(x) \Rightarrow\\\\ & \frac{\partial\ln f(x|\theta)}{\partial\theta} = \frac{1}{\theta} + \ln(x) \Rightarrow \frac{\partial^{2}\ln f(x|\theta)}{\partial\theta^{2}} = -\frac{1}{\theta^{2}} \Rightarrow\\\\ & -\textbf{E}\left(\frac{\partial^{2}\ln f(x|\theta)}{\partial\theta^{2}}\right) = \frac{1}{\theta(1+\theta)} \Rightarrow I_{F}(\theta) = \frac{1}{\theta(1+\theta)} \end{align*}

However, I am little bit lost here. I know the expectation of the score function equals zero and its variance equals $I_{F}(\theta)$. I also know that the distribution of the score function is asymptotic normal, but I am unsure about which pivotal quantity should we use. Precisely speaking, should it be \begin{align*} \text{Pivot}(\textbf{X},\theta) \stackrel{\displaystyle?}{=} \frac{1}{\sqrt{nI_{F}(\theta)}}\displaystyle\sum_{i=1}^{n}U(X_{i},\theta),\quad\text{where}\quad U(X_{i},\theta) = \frac{\partial\ln f(x_{i}|\theta)}{\partial\theta} \end{align*}

If so, can someone tell me the explicit expression of the confidence interval? Any help is appreciated. Thanks in advance.

$\endgroup$
1
  • 3
    $\begingroup$ If the score $U(\mathbf X)=\frac{\partial}{\partial\theta}\ln f(X_1,\ldots,X_n\mid \theta)$ is such that $U\stackrel{a}\sim N(0,I(\theta))$, then definitely a pivot is $\frac{U}{\sqrt{I(\theta)}}\sim N(0,1)$. $\endgroup$ Commented Apr 14, 2019 at 22:40

1 Answer 1

3
$\begingroup$

To expand on my comment, you could have worked directly with the score for the combined sample $\mathbf X$.

From the joint pdf of $\mathbf X$, it follows that the score function is $$\frac{\partial}{\partial\theta}\ln f(\mathbf X\mid\theta)=\sum_{i=1}^n \ln X_i+\frac{n}{\theta}$$

So the asymptotic distribution of the score is equivalent to the limiting distribution of $\sum\limits_{i=1}^n \ln X_i$.

By CLT, $$\frac{\sum_{i=1}^n \ln X_i+\frac{n}{\theta}}{\sqrt{\frac{n}{\theta^2}}}\stackrel{L}\longrightarrow N(0,1)$$

Note that the Fisher information in $\mathbf X$ is actually $$I(\theta)=-n E_{\theta}\left[\frac{\partial^2}{\partial\theta^2}\ln f(X_1\mid\theta)\right]=\frac{n}{\theta^2}$$

So the pivot you are looking for is eventually $$\frac{1}{\sqrt n}\left(\theta\sum_{i=1}^n \ln X_i+n\right)\stackrel{L}\longrightarrow N(0,1)$$


Exact confidence intervals for $\theta$ are also availabe, a suitable pivot being

$$-2\theta\sum_{i=1}^n \ln X_i\sim \chi^2_{2n}$$

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.