Questions tagged [admissibility]

Admissible estimator: there is no other estimator for which the risk is $\leq$ for all possible true values of the target parameter.

Filter by
Sorted by
Tagged with
1 vote
2 answers
74 views

James-Stein-style estimator when we place greater importance on some components

The James-Stein estimator allows us to get a better overall estimate of a mean vector (length $\ge 3$) than we would be able to get by estimating the components independently. My intuition is that, ...
user avatar
  • 31.3k
2 votes
1 answer
107 views

Is a constant ever inadmissible?

For now, assume square loss. Let's estimate some parameter $\theta$, such as $\theta = \mu$ in $N(\mu, 1)$. Is there ever a case where there is no such $c$ to make $\hat{\theta} = c$ an admissible ...
user avatar
  • 31.3k
13 votes
1 answer
342 views

Is $\frac1{n+1}\sum_{i=1}^n(X_i-\overline X)^2$ an admissible estimator for $\sigma^2$?

Consider a sample $X_1,X_2,\ldots,X_n$ from a univariate $N(\mu,\sigma^2)$ distribution where $\mu,\sigma^2$ are both unknown. Then it is known that under squared error loss, the sample variance $s^2=\...
user avatar
  • 9,120
0 votes
1 answer
54 views

General Strategy to show an estimator is admissible?

I am getting into decision theory and I was wondering if there was a general way to check if a an estimator is admissible. (PS This question might have already been asked, sorry if that is the case I ...
user avatar
5 votes
1 answer
246 views

Admissible Empirical Bayes Examples

I would like to hear about a few simple empirical bayes estimators that are admissible for high (i.e. at least 3) dimensional parameter space. What are some textbook lollipop examples to study for ...
user avatar
2 votes
0 answers
159 views

Inadmissible MLE

Let us say, I have a distribution with some unknown parameter and I find the MLE of the parameter. I prove that the MLE is inadmissible using some other estimator. Why is this not in a contradiction ...
user avatar
  • 185
18 votes
0 answers
369 views

Empirical Bayes (In)Admissibility

Most of the time, sticking to a pure Bayesian approach to statistics with proper priors, leads to admissible estimators. Nevertheless, there is a good reason to use Empirical Bayes in many cases, and ...
user avatar
3 votes
2 answers
687 views

Admissible Bayes Rule

In the following wikipedia entry https://en.wikipedia.org/wiki/Admissible_decision_rule it is written that "Bayes rules with respect to proper priors are virtually always admissible" What do they ...
user avatar
5 votes
0 answers
288 views

Is an inadmissible estimator necessarily dominated by some admissible estimator

Basic example: $X$ has a $p$-variate iid standard Normal distribution; the sample mean is not admissible if $p>2$ and is dominated by the Stein shrinkage estimator. However, the Stein shrinkage ...
user avatar
8 votes
1 answer
696 views

Model with admissible estimator(s) that are not the Bayes estimator for any choice of prior?

Every Bayes estimator is admissible, to the best of my knowledge. (Related questions - 1,2.) I recall my professor mentioning once during a lecture that, at least as rough intuition, the converse is ...
user avatar
  • 5,699
4 votes
1 answer
354 views

How to choose loss function (in unbounded parameter space)?

How does one choose a loss function for a given problem? (I've looked through stackexchange, and I haven't been able to find a thread that discusses this.) Let say I observe some data $x \in \mathbb{...
user avatar
  • 2,702
1 vote
0 answers
115 views

Well structured data

In the paper "Admissible clustering procedures" the authors Van Ness and Fisher (1971) have explained well structured data as follows: Data is said to be well structured if it has exact tree ...
user avatar
  • 552
4 votes
2 answers
232 views

Admissibility under the loss function

Suppose $X_1 , ..., X_n$ are random samples of exponential distribution with mean $\theta$. Determine $a$ and $b$ such that $a\sum_{i=1}^n X_i +b$ be admissible under the loss function $L(\theta,\...
user avatar
5 votes
1 answer
289 views

Admissibility of Bayes estimators

I have the following questions. They are not homework problems, but they are things that the professor said that I should wonder about. I suspect that I will have to deal with this on an exam in the ...
user avatar
  • 215
4 votes
1 answer
1k views

On the proof of admissibility of constant estimators under squared loss

The question concerns the discussion in Wasserman, All of Statistics, Section 13.6. He defines: An estimator $\hat{\theta}$ is inadmissible if there exists another rule $\hat{\theta}'$ such that ...
user avatar
8 votes
0 answers
256 views

Why is Wald's decision theory not universally recognized as the foundation of statistics?

This is somewhat ill-defined, but: Why is Wald's decision theory not universally recognized as the foundation of statistics? I gather (or maybe I infer) that it was formulated to put frequentist and ...
user avatar
3 votes
1 answer
166 views

Why is the MLE/OLS estimator so common in regression despite inadmissibility? [closed]

Why is regression so commonly used if the OLS estimator for the vector of regression coefficients is inadmissible under the squared error loss function? Is it because of its historical popularity or ...
user avatar
  • 1,137
3 votes
2 answers
1k views

Admissible Estimator for Linear Regression

Is there an admissible estimator for a linear regression model with many parameters without restricting the parameter space? Admissibility will be with respect to Mean Square Error on the regression ...
user avatar
5 votes
1 answer
455 views

showing that $\bar{X}$ is inadmissible by comparing with $\max(\bar{X},2)$ under squared error loss function

suppose $X_1,X_2,\ldots,X_n$ be a random sample of $N(\theta,1), \theta>2$. how can I show $\bar{X}$ is inadmissible estimator Compared to $\max(\bar{X},2)$ under Squared error loss function
user avatar
  • 109