Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 11887

Refers to an estimator of a population parameter that "hits the true value" on average. That is, a function of the observed data $\hat{\theta}$ is an unbiased estimator of a parameter $\theta$ if $E(\hat{\theta}) = \theta$. The simplest example of an unbiased estimator is the sample mean as an estimator of the population mean.

1 vote

Unbiased estimator of p in geometric distribution

Assuma as StubbornAtom in a comment that we have only one observation and that $P(X=j)=p(1-p)^j\mathbf1_{j\in\{0,1,2,\ldots\}}$ and $T(X) = \mathcal{I}_{\{X=0\}}$. Then just calculate the expectatio …
kjetil b halvorsen's user avatar
1 vote

How to find an unbiased estimator for reciprocal of scale parameter given an iid exponential...

So far this is more of a long comment. You are right that $\bar{x}$ have an Erlang distribution, that is, a Gamma distribution. (Refer to Wikipedia). I find the following density for $\bar{x}$ $$ f( …
kjetil b halvorsen's user avatar
6 votes
Accepted

Where does linear regression fit into the bias-variance tradeoff?

OLS is an unbiased estimator assuming the model is true, which is to say, Effects are exactly linear All variables with non-zero effects are included All interactions are included no non-linear effe …
kjetil b halvorsen's user avatar
1 vote

Do we need an unbiased estimator of the variance?

Depends on what your end goal is. It the end goal is inference on regression coefficients (t-tests) then the unbiased variance estimator is just a stepping stone, and unimportant in itself. But for …
kjetil b halvorsen's user avatar
12 votes

Questions about unbiased sample variance

Many misunderstandings here. It would be easier to answer if you defined your terms and included some formulas. But: 1) NO, it is not correct to say that an unbiased estimator is necessarily close …
kjetil b halvorsen's user avatar
4 votes

Is an WLS estimator unbiased, when wrong weights are used?

It is unbiased, let's see: Let the linear model be $Y=X\beta +e$, in matrix form, with $E e=0$ and the variance-covariance matrix of the errors $e$ be $\Omega$. We use for weights the matrix $W$. Th …
kjetil b halvorsen's user avatar
5 votes
Accepted

Is the sample mean an unbiased estimator of population mean in the presence of autocorrelation?

Yes, autocorrelation (or spatial correlation or ...) do not destroy the unbiasedness of the sample mean as an estimator of population mean. Expectation is a linear operator, so when you calculate the …
kjetil b halvorsen's user avatar
5 votes

Ratio of Unbiased Estimators

No, it will not be unbiased (unless the estimator of the denominator have zero variance.) And it will not help if the numerator and denominator are independent. In general, if $\hat{\theta}$ is an un …
kjetil b halvorsen's user avatar
11 votes

Best estimator of the mean of a normal distribution based only on box-plot statistics

An exact answer will be difficult, so first I will look at asymptotic theory. Answers from that could be tested by simulation, comparing it to a maximum likelihood estimator computed by maximizing an …
kjetil b halvorsen's user avatar
1 vote
Accepted

Good parameter estimates vs good computed moment estimates

You have data from some distribution family $f(y; \theta)$ and some estimator $\hat{\theta}$ of $\theta$ with "good properties". But you are interested in some function of $\theta$, say $g(\theta)$ ( …
kjetil b halvorsen's user avatar
2 votes

Unbiased estimators of the log odds

For the case $g(p)=1/p$, a more rigorous proof for nonexistence of unbiased estimators is For the binomial distribution, why does no unbiased estimator exist for $1/p$?. With $g(p)=\log\frac{p}{1-p}$ …
kjetil b halvorsen's user avatar
3 votes
Accepted

What is an "unbiased forecast"?

We can write your predictor for $Y_h$ as $$ \widehat{Y_h}=T\left(W(x,y),X_h\right) $$ Then $\widehat{Y_h}$ is unbiased as a predictor for $Y_h$ if $$ \DeclareMathOperator{\E}{\mathbb{E}} \E \{\wideh …
kjetil b halvorsen's user avatar
0 votes

Complete sufficient statistic and unbiased estimator

No, there are examples where there is a complete sufficient statistic but there is some function of the parameter that does not admit an unbiased estimator. One binomial example, noted in comments, is …
kjetil b halvorsen's user avatar
7 votes
Accepted

Variance of unbiased estimator for the shape parameter of Pareto distribution

I will write the standard Pareto distribution with density $$ f(x;\alpha,x_m)=\frac{\alpha x_m^\alpha}{x^{\alpha+1}}\cdot I(x > x_m), $$ for some $\alpha>0, x_m>0$. Then the loglikelihood function …
kjetil b halvorsen's user avatar
2 votes
Accepted

What is the problem in the Neyman-Scott problem?

Partially answered in comments: The problem has nothing to do with the fact that the bias can be corrected. It's that a particular procedure--namely, the Maximum Likelihood estimator--does not enjoy a …
kjetil b halvorsen's user avatar

15 30 50 per page