Point estimation is the application of an estimator to the data in order to learn about a certain population parameter.

learn more… | top users | synonyms

0
votes
0answers
11 views

Does Cramer-Rao Inequality needs the parameter space to be an open subset of the real line?

I came across a lecture on Cramer-Rao lower bounds for an unbiased estimator and the visiting professor remarked that for CR inequality to be valid one of the regularity conditions we need is that the ...
1
vote
0answers
18 views

What is λ in the context of Spatial Point Statistics?

What is a small lambda λ in the context of spatial point statistics and how do I calculate it for a given set of point? Specifically I am trying to calculate it for different sets of observations of ...
2
votes
0answers
27 views

Does an Efficient Unbiased Estimator exist for a function of a parameter of an exponential family distribution?

Say I have an i.i.d. sequence sequence $X_1,\ldots X_n \sim \text{Bernoulli}(p)$, and I am interested in estimating $p^2$. Let $T$ denote $\sum_{i=1}^n X_i$. It turns out that the mle $\bar X^2 = ...
1
vote
1answer
37 views

estimating a parametric function

I am working on this problem and am stumped. Can anyone take a look at it? $X_1, \ldots ,X_n$ are distributed Bernoulli$(p)$ where $p$ is unknown. Consider the parametric function ...
0
votes
1answer
42 views

Practical situation in which the posterior mean is prefered to the MAP

Sometimes experts for which we design models are interested in having a point estimate and in practical situations, they always say me "give us the most probable parameter value". And whether the ...
3
votes
1answer
40 views

Estimating accurately the mean of an autocorrelated bounded integer time series

I have a bounded integer time series $X_{1:\infty}$ ($1\leq X_k\leq M$), and I want to estimate the mean $$ s = \lim_{L\to\infty} \frac{1}{L}\sum_{k=1}^L X_k. $$ I'm assuming it exists and that $X_k$ ...
4
votes
1answer
52 views

Cramér-Rao Lower Bound for Exponential Families

I am having a problem with applying the Cramér-Rao inequality to identify the lower bound for the variance of an unbiased estimator and hoped that you guys could help me. The problem is the following: ...
1
vote
1answer
54 views

How to get the maximum likelihood estimator of $U(\theta,\theta +1)$?

I know how to find the MLE for $U(0,\theta)$ but I am in trouble with this one. let $X_1,\dots,X_n$ be a random sample from $U(\theta,\theta +1)$. Consider the following three estimators for ...
3
votes
0answers
43 views

Does the UMVUE have to be a minimal sufficient statistic?

I'm studying point estimation and I have found this question that seems pretty tricky to me. If $T$ is a minimal sufficient statistic for $\theta$ with $E(T) = \tau(\theta)$, can you say that $T$ ...
1
vote
0answers
26 views

Observed Fisher Info as an estimator of Expected Info

When I construct an asymptotic confidence interval for a parameter $\theta$, taken from a sample iid distributed with a generic pdf/pmf, I usually implement the mle $\hat\theta$ instead of $\theta$, ...
3
votes
2answers
119 views

Asymptotic properties of MLEs

Are there any relationship between the asymptotic properties of MLEs (assuming that the regularity conditions hold)? I mean, once I know that the MLE for $\tau(\theta)$ is asymptotically efficient ...
0
votes
1answer
28 views

Efficient estimators and CRLB

An estimator is efficient if it reaches the Cramér-Rao Lower Bound and since it is efficient, it is also the UMVU estimator of the parametric function $\tau(\theta)$. But Cramér-Rao inequality and the ...
2
votes
1answer
112 views

Are complete statistics always sufficient?

I know that a complete sufficient statistic $T$ is such that 1) $T$ is sufficient for $\theta$, unknown parameter and 2) $T$ is complete. So, is it always the case? If the answer is not, what ...
2
votes
2answers
68 views

Cramér-Rao inequality and MLEs

I know that if it exists, a regular, unbiased estimator $T$ for $\tau(\theta)$ attains the Cramér-Rao Lower Bound (next, CRLB) if and only if I can decompose the score function as follows: ...
3
votes
0answers
47 views

Fisher information for uniform distribution [closed]

If I want to compute the CRLB for iid uniform on $[0,\theta]$. I need in the denominator this expression: $E_\theta\left[\left(\frac{\partial \log f(X)}{\partial ...
1
vote
0answers
27 views

Estimation of the mean when data points are not independent

When we estimate the mean with 95% confidence, this formula is used: $\hat{\mu}=\overline{\mu}\pm1.95\times\frac{\overline{\sigma}}{\sqrt{N}}$, where $\overline{\mu}$ is the sample mean, ...
1
vote
0answers
17 views

Point configuration given distribution of distances

Does anybody know if there is a method/algorithm to find coordinates for $N$ points, given a probability density function from which the $N(N-1)/2$ different pairwise distances between them can be ...
0
votes
0answers
34 views

Limits of integration of Pitman Estimator for Laplace (Double exponential) distribution

I am struggling, in general and specifically, with trying to determine the limits of integration for the Pitman Estimator to find a Minimum Risk Equivariant (MRE) estimator of a location parameter ...
30
votes
3answers
1k views

Is p-value a point estimate?

Since one can calculate confidence intervals for p-values and since the opposite of interval estimation is point estimation: Is p-value a point estimate?
0
votes
1answer
617 views

How to derive the likelihood function for binomial distribution for parameter estimation?

According to Miller and Freund's Probability and Statistics for Engineers, 8ed (pp.217-218), the likelihood function to be maximised for binomial distribution (Bernoulli trials) is given as $L(p) = ...
4
votes
1answer
57 views

complete sufficient statistic exercise

I have to find complete sufficient statistic of the following pdf $$f(x|\theta)=\frac{\theta}{(1+x)^{(1+\theta)}},\quad 0<x<\infty,\theta>0.$$ My Attempt: The joint density $$f(\mathbf ...
0
votes
0answers
30 views

estimate ranking and winning probability of N players after observing the each pair of players' matching results

Question: N people are ranked from the highest to the lowest with no ties, but we do not know the precise rankings. When two people have a match, the one with higher rank wins with a probability p > ...
0
votes
0answers
13 views

Using Horvitz-Thompson for estimation from a simple random sample with unknown membership probability

I learnt about the Horvitz-Thompson estimator yesterday, and am trying to apply it to the degenerate case where $p$ is uniform for each, but I seem to have run into a bit of a confusing situation. ...
4
votes
1answer
108 views

Estimating sample mean from a biased sample (whose generative process is known)

I'm working on a problem where I'm trying to estimate some property of a dataset from a small non-uniform sample. (Let's just take the population mean because it's simple.) Formally, assume I have ...
2
votes
1answer
172 views

point estimation--an interview

I've encountered the following interview question: ...
1
vote
0answers
32 views

Finding the Estimated Standard Error of a 10%/90% data division estimator

I am learning about estimated standard error of an estimator, which is defined as the square root of the variance of the estimator: $\sqrt{V(\Theta)}$ Given the data, assumed to be from a normal ...
1
vote
0answers
48 views

UMVUE for pareto distribution

Let $X_1,..X_n$ random sample with $f(x;\theta,a)=\frac{\theta}{a}(\frac{a}{x})^{(\theta+1)}I_{(a,\infty)}(x),a>0,\theta>0$. Find the UMVUE for $\theta$ when $a$ is fixed. My attempt ...
3
votes
1answer
105 views

Cramer-Rao Lower Bound

Let $X_1,..,X_n$ be an iid sample of $N(0,\sigma^2)$. Find an unbiased estimator of $\sigma^2$ and its lower bound. I found that $$\hat{\sigma}^2 = \sum_{i=1}^{n} X_i^2$$ is an unbiased ...
0
votes
1answer
33 views

Unbiased estimator and variance

A random sample of n people are asked whether they are against smoking or not. Suppose x are against smoking. What is the distribution of the random variable X (number of those against smoking). State ...
1
vote
4answers
92 views

How many samples needed to approximate true mean?

If I have some arbitrary random variable with true mean $\mu$ how many samples from its distribution do I need to take such that the empirical mean $x$ approximates $\mu$ within an error of less than ...
21
votes
1answer
317 views

Shrunken $r$ vs unbiased $r$: estimators of $\rho$

There has been some confusion in my head about two types of estimators of the population value of Pearson correlation coefficient. A. Fisher (1915) showed that for bivariate normal population ...
3
votes
1answer
57 views

Self Study: ML Parameter Estimates — do I need numerical maximization?

I have a particular PDF with two parameters, specified as: $$\alpha \beta e^{-\beta x}(1 - e^{-\beta x})^{\alpha - 1}, \alpha > 0, \beta > 0, x_i > 0$$ Given a random iid sample $(x_1, ...
2
votes
0answers
36 views

A Proof of Tukey's Inequality

Suppose that $W_1,W_2,...,W_n$ are uncorrelated unbiased estimators of a parameter $\theta$. Consider $W=\sum_{i=1}^na_iW_i$ such that $E(W)=\theta$ and $Var(W_i)=\sigma^2_i$, where the $a_i$'s are ...
8
votes
1answer
156 views

Sufficiency or Insufficiency

Consider a random sample $\{X_1,X_2,X_3\}$ where $X_i$ are i.i.d. $Bernoulli(p)$ random variables where $p\in(0,1)$. Check if $T(X)=X_1+2X_2+X_3$ is a sufficient statistic for $p$. Firstly, ...
1
vote
1answer
125 views

Calculating means and confidence intervals when most data points are 0

I am looking at data set that has four groups. In each group, the data is mostly, 99+% of time, composed of zeros, but, when it is not zero it can be any float number (e.g., 0.01 to 921.2, with most ...
0
votes
1answer
24 views

Prevalence estimates based on randomized sample of clinical data

This is probably one of the more straight forward questions on here but here it is: I want to use a random number generator to sample X number of charts to look for the # occurrences of Y event. So ...
0
votes
0answers
62 views

Shape uncertainty of a 3D point cloud

Given a point cloud of a 3D object, how to calculate the shape uncertainty in this discrete sample set? and what factors maximize or minimize this uncertainty?
2
votes
1answer
58 views

Is there an article/book reviewing different methods for constructing posterior point/interval estimates?

Given a one-dimensional posterior distribution it is often the case that you want to calculate a point estimate and a credible interval for the corresponding parameter. There are, of course, many ways ...
6
votes
2answers
379 views

Why is the geometric median called the $L_1$ estimator?

My question is simply, why is the geometric median called the $L_1$ estimator? This always reminds of $L_p$ spaces but the distance being minimized in the geometric median's definition isn't $L_1$ but ...
2
votes
0answers
50 views

How to find conditional distribution for Rao-Blackwellizing an estimator?

Let's say I have an unbiased estimator $u(\underline x)$ for function $v(\theta)$ where $\theta$ is a parameter of the distribution of $x$, and $T(\underline x)$ which is a sufficient statistic for ...
6
votes
1answer
149 views

Cramer-Rao bound for $\chi^2$ distribution parameter estimates

I've struck an unpleasant problem with the noncentral $\chi^2$ distribution. I work with random variables, distributed as $\chi^2_{\nu}(\lambda)$, where $\nu$ is the degree of freedom and $\lambda$ ...
0
votes
0answers
160 views

Biased but consistent estimator for the mean of Gaussian distribution?

$(X_1,X_2,\ldots,X_n)$ is a random sample from $\mathrm{N}(θ, 1)$. We know sample mean is a unbiased estimator that is consistent. What would be a biased but consistent estimator for θ? Would it be ...
2
votes
0answers
133 views

Comparing two estimators for accuracy using empirical bootstrap

I am trying to figure out the proper way to compare the quality of two estimators of a parameter based on data. The basic approach I've taken is to compute the MSE of the empirical bootstrap ...
1
vote
0answers
37 views

EM Algorithm - Expectation w.r.t. a subset of current parameters

Suppose I want to make inference on a parameter vector $\theta $=$(\theta_{1},\theta_{2},\theta_{3})$ and I have some missing data $Y_{mis}$. I would like to use the EM algorithm to find the mode of ...
1
vote
1answer
232 views

Show that $\mathbb{E}(g(T-p)) < \mathbb{E}(g(S-p))$ for any convex function $g$ if $T$ and $S$ are estimators of $p$

The more detailed question. I'm kinda having some trouble starting out with answering this question. My initial approach would be to $g(x)= x^2$ since that is a convex function and find the ...
2
votes
2answers
115 views

Why we shouldn't be obsessed with unbiasedness

In my Bayesian statistics class, my professor makes the remark that we should not be obsessed with unbiased estimator. First: I understand this statement in the sense of trading biasedness for ...
2
votes
0answers
86 views

Estimation of unknown vector's amplitude with Gaussian noise

I have the following model: y = P v + n Where y is the vector of observations, v is a unit vector and n is a Gaussian random noise whose covariance matrix is the identity matrix. P is a positive ...
1
vote
0answers
196 views

Calculating point estimates from model-averaged parameters

I'm using an IT-approach and multi-model inference with some count data. I have used model averaging to obtain parameter estimates from several GLMMs with Poisson-lognormal errors (Poisson family ...
2
votes
1answer
3k views

Confidence Interval for a Random Sample Selected from Gamma Distribution

Working on a homework question and having some trouble... Any help would be greatly appreciated. Based on a sample 1.23, 0.36, 2.13, 0.91, 0.16, 0.12 from the GAM$(2,\theta)$ distribution, find an ...
0
votes
0answers
608 views

How to use a point estimator on an interval?

I got part a and part b just fine, but I am confused on how to do part (c), (d), and (e). I don't really understand what the question is asking, nor do I understand how to do that sort of interval ...