Skip to main content
Notice removed Draw attention by Cagdas Ozgenc
Bounty Ended with Ben's answer chosen by Cagdas Ozgenc
Tweeted twitter.com/StackStats/status/1060502357497274368
edited tags
Link
Ferdi
  • 5.3k
  • 10
  • 47
  • 64
Notice added Draw attention by Cagdas Ozgenc
Bounty Started worth 100 reputation by Cagdas Ozgenc
deleted 4 characters in body
Source Link
Cagdas Ozgenc
  • 4.5k
  • 4
  • 32
  • 68

I have the classical regression model

$$y = \beta X + \epsilon$$ $$\epsilon \sim N(0, \sigma^2)$$

where $X$ is taken to be fixed (not random).

If, and $\hat\beta$ is the OLS estimate for $\beta$, then it.

It is known that $(y^T y, X^T y)$ pair is a complete sufficient statistic for $x_0^T \beta$, for some input $x_0$.

Can we conclude that $(y^T y, X^T y)$ is also a sufficient statistic for $\beta$, and why? I think for this to work $X^T X$ should be full rank. I mean a 1 to 1 transformation of a sufficient statistic is still a sufficient statistic, but it is still a sufficient statistic for $x_0^T \beta$. Based on what are we going to conclude the sufficiency of $\hat\beta$ for $\beta$ itself?

I have the classical regression model

$$y = \beta X + \epsilon$$ $$\epsilon \sim N(0, \sigma^2)$$

where $X$ is taken to be fixed (not random).

If $\hat\beta$ is the OLS estimate for $\beta$, then it is known that $(y^T y, X^T y)$ pair is a complete sufficient statistic for $x_0^T \beta$, for some input $x_0$.

Can we conclude that $(y^T y, X^T y)$ is also a sufficient statistic for $\beta$, and why? I think for this to work $X^T X$ should be full rank. I mean a 1 to 1 transformation of a sufficient statistic is still a sufficient statistic, but it is still a sufficient statistic for $x_0^T \beta$. Based on what are we going to conclude the sufficiency of $\hat\beta$ for $\beta$ itself?

I have the classical regression model

$$y = \beta X + \epsilon$$ $$\epsilon \sim N(0, \sigma^2)$$

where $X$ is taken to be fixed (not random), and $\hat\beta$ is the OLS estimate for $\beta$.

It is known that $(y^T y, X^T y)$ pair is a complete sufficient statistic for $x_0^T \beta$, for some input $x_0$.

Can we conclude that $(y^T y, X^T y)$ is also a sufficient statistic for $\beta$, and why? I think for this to work $X^T X$ should be full rank. I mean a 1 to 1 transformation of a sufficient statistic is still a sufficient statistic, but it is still a sufficient statistic for $x_0^T \beta$. Based on what are we going to conclude the sufficiency of $\hat\beta$ for $\beta$ itself?

Source Link
Cagdas Ozgenc
  • 4.5k
  • 4
  • 32
  • 68

Sufficient Statistic for $\beta$ in OLS

I have the classical regression model

$$y = \beta X + \epsilon$$ $$\epsilon \sim N(0, \sigma^2)$$

where $X$ is taken to be fixed (not random).

If $\hat\beta$ is the OLS estimate for $\beta$, then it is known that $(y^T y, X^T y)$ pair is a complete sufficient statistic for $x_0^T \beta$, for some input $x_0$.

Can we conclude that $(y^T y, X^T y)$ is also a sufficient statistic for $\beta$, and why? I think for this to work $X^T X$ should be full rank. I mean a 1 to 1 transformation of a sufficient statistic is still a sufficient statistic, but it is still a sufficient statistic for $x_0^T \beta$. Based on what are we going to conclude the sufficiency of $\hat\beta$ for $\beta$ itself?