Questions tagged [point-estimation]
Point estimation is the application of an estimator to the data in order to learn about a certain population parameter.
0
votes
1answer
22 views
check understanding on unbiased and consistent estimator
I'm trying to understand the expected value of an estimate. Here's my understanding.
The expected value of the estimate $\bar x$ of the parameter $\mu$ is what the mean of xbar tends to as we ...
0
votes
1answer
21 views
What is the maximum likelihood estimator for $e^{-\theta}( (P(X_i = 0))$?
Suppose $X_i$ is $iid$ $Poisson(\theta)$
What is the maximum likelihood estimator for $e^{-\theta}(= P(Xi = 0))$?
I already found the MLE for the $\theta$. how do you then find the MLE of $e^{-\...
2
votes
1answer
25 views
Linear regression with error dispersion dependent on the independent variable
Suppose $y=ax+z$ where $x, y, z$ are random variables with range in $\mathbf R$, $\mathbf E[x]=0$, the probability distribution $p(z|x)$ is
1) normal distribution $N(0,\sigma(x)^2)$ with mean $0$ ...
2
votes
0answers
56 views
Recommended point estimate for non-normal distribution?
I have a rather non-normal marginalized posterior for some parameters, resulting from a Bayesian MCMC. Example:
I know that the actual distribution is what truly represents the parameter, but I need ...
2
votes
3answers
397 views
Deriving likelihood function of binomial distribution, confusion over exponents
This question focuses on a specific aspect of this one:
How to derive the likelihood function for binomial distribution for parameter estimation?
In my own derivation, I start with:
$$f(x\mid p) = ...
2
votes
0answers
16 views
Estimating the number of tokens in a pile
We have a pile of tokens numbered from $1$ to $n$, where $n$ is unknown. $k$ tokens are drawn from the pile at random without replacement(i.e. the numbers that we get from tokens are unique). Say the ...
0
votes
0answers
71 views
Simultaneous estimation of a group of linear model (regression) parameters
Suppose $y=ax+z$ where $x, y, z$ are random variables with range in $\mathbf R$, $\mathbf E[x]=\mathbf E[z|x]=0$ and $a$ is a constant. Note the distribution of $z$ conditioned on $x$ depends on $x$. ...
0
votes
1answer
29 views
Estimating standard deviation when observing means of various block sizes
I have a sequence $X_i$ of iid random variables (you may assume gaussian distribution if you like) but I only observe the mean value of disjoint blocks of various sizes of $X_i$. E.g. $M_1 = \frac14 \...
2
votes
1answer
194 views
Proof that posterior median is the Bayes estimate of absolute loss?
It is always argued that the posterior median is the Bayes estimate associated to the absolute loss function. The proofs I have come across rely on differentiating the conditional Bayesian risk and ...
0
votes
0answers
12 views
Restricting Properties of Point Estimators in Discrete, Unordered Parameter Spaces
A common principle used to deal with the fact that there are typically no uniformly best estimators (in the sense that they uniformly have least frequentist risk) seems to be to restrict the space of ...
3
votes
1answer
68 views
MVUE is unique - wrong proof?
Here is the proof of "MVUE is unique" that my lecturer gave:
Now I understand the following:
The first expansion is done using the formula for the sum of correlated random variables (https://en....
1
vote
0answers
18 views
Unbiased estimate of sign of mean
Consider the set $\mathcal{P}$ of probability distributions that have a finite first moment and define the function $\operatorname{sgn} :\mathcal{P} \to \mathbb{R}$ as
$$
\operatorname{sgn}(\mu) = \...
1
vote
0answers
17 views
Two point estimates fall into same confidence interval
Say I have two populations, and I am computing a sample mean and a corresponding (1-$\alpha)100 \%$ confidence interval for each. Now, I understand that if the confidence intervals are disjoint, then ...
2
votes
1answer
38 views
It what situation is a distribution known to be symmetric, but about an unknown location?
A favorite example in theoretical statistics is this:
A sample of individuals are drawn independently from a distribution with density $f(x)$, where $f(x)$ is unknown, but is known to be symmetric ...
0
votes
1answer
47 views
Minimal sufficient statistic whose dimension is less than dimension of parameter
Consider following example:
Suppose $ X\sim N(0, \sigma^2) $,
consider a random sample of size one from this population.
Clearly $X$ is sufficient statistic but $ |X| $ is minimal sufficient ...
2
votes
1answer
306 views
Efficiency, Precision, Accuracy, and Consistency
Can anyone please explain me the statistical terms efficiency, precision, accuracy, and consistency in plain language with easy example (hopefully by daily life example)?
So far, my understanding of ...
2
votes
1answer
29 views
Multidimensional Bayes point estimates
Consider the posterior distribution $p(\theta|x)$. We aim to find a "good" estimate of the random variable $\theta$. The Bayes risk associated with the loss function $L(\hat{\theta}, \theta)$ is ...
1
vote
0answers
41 views
comparison of two estimators
Assume we have a data set $\mathbf{x}_{n} = (x_{1}, \dots, x_{n})$. Let $\delta_{1}(\mathbf{x}_{n})$ and $\delta_{2}(\mathbf{x}_{n})$ be two consistent estimators of some parameter $\theta \in R^{k}$. ...
9
votes
3answers
284 views
Does a Bayes estimator require that the true parameter is a possible variate of the prior?
This might be a bit of a philosophical question, but here we go: In decision theory, the risk of a Bayes estimator $\hat\theta(x)$ for $\theta\in\Theta$ is defined with respect to a prior distribution ...
5
votes
1answer
62 views
About the variance of a weighted sum
What can be said about the variance of the following quantity
$$
\frac{1}{n}\sum_{i=1}^n \left(\frac{f(x_i)}{\sum_{j=1}^nf(x_j)}-b\right)g(x_i) ?
$$
Here, $b \in [0, 1]$, and the $x_i$s are i.i.d ...
0
votes
0answers
42 views
Machine learning - shatter the point and VC dimension
I failed to understand this question , I'm not strong with all the upper-bound topic I would really appreciate a solution with good explanation, heres the question:
Class C includes functions of the ...
2
votes
2answers
51 views
Computing variance from a set of samples
My dataset contains a set of samples from a set of normal RVs. Each RV is normally distributed with equal variances and varying means. However, I have only two samples from each RV.
How to estimate ...
0
votes
1answer
64 views
MME for exponential family
Let $X_1, X_2,...,X_n$ be iid random variables having pdf
$$f(x|\theta) = \frac{1}{x \sqrt{2\pi\theta}}e^{(-[\log x]^2/[2\theta])} I_{(0,\inf)}(x)$$ where $\theta > 0$. Determine the MME of $\theta$...
0
votes
0answers
59 views
Determining an MLE
I am trying to find the MLE of $\theta$ for $X_1, X_2,...,X_n$ with the following pdf:
$$f(x|\theta) = \frac{\log(\theta)}{\theta - 1} \theta^{x}$$
I determined the joint density and got:
$$\prod_{...
0
votes
1answer
713 views
MLE for variance of a lognormal distribution
Let $X_1, X_2,...,X_n$ be iid random variables having pdf
$$f(x|\theta) = \frac{1}{x \sqrt{2\pi\theta}}e^{(-[\log x]^2/[2\theta])} I_{(0,\inf)}(x)$$ where $\theta > 0$.
Determine the MLE of $\...
-1
votes
1answer
36 views
Find the Method of moments estimate
So here i am getting E(X)=1/2,E(X^2)=0 and E(X^3)=Theta squared/4
How do i proceed now?How do i use the given x values ?
2
votes
1answer
51 views
What is the maximum likelihood estimator of the given distribution?
Let $X_{1},...,X_{n}$ be independent random variables with $X_{k}$ having the normal distribution with mean $k\theta$ and variance $\sigma^2$. Find the maximum likelihood estimator of $\theta$.
My ...
0
votes
1answer
73 views
Maximum likelihood estimator of $\theta$ of the following probability distribution
Let $x_{1}=-2,x_{2}=1,x_{3}=3,x_{4}=-4$ be observed values from the following density function:
$f(x|\theta)=\frac{e^{-x}}{e^{\theta}+e^{-\theta}}$ where the support is $-\theta \leq x\leq\theta$.
...
1
vote
0answers
32 views
Are exponential families uniformly continuous?
It is common to consider log-likelihood $$l(x_1,\cdots,x_n,\theta) :=\frac{1}{n}\sum_{i=1}^n \log f\left(x_i,\theta\right)$$
where $f$ is density function of $X$.
Under what conditions is the ...
3
votes
1answer
68 views
What is the intuitive meaning of autocorrelation - when is $r_xx[0] = 1$
Consider a linear model $y_n = \beta x_n + v_n$
where $n$ represents the time index, $x$ is the input data source
$\hat{\beta}_{OLS} = (X^TX)^{-1}X^Ty$ is the ordinary least square estimate of the ...
1
vote
1answer
70 views
Estimating a GCD
I have two related questions.
Question 1: Let $k_1, \ldots k_n$ be positive integers, and $\alpha_1, \ldots \alpha_n \in (0,1)$ be such that $\sum_{j \leq n} \alpha_j = 1$.
Suppose $\langle X_m \...
1
vote
1answer
50 views
Best plausible estimate of parameter of hypergeometric distribution
Consider the Urn problem where a hypothetical urn contains a finite number of $m$ balls, $r$ of which are black and $m-r$ are white. We take a random sample without replacement of $n$ balls and ...
1
vote
1answer
53 views
How would you find the MLE of this pairwise exponential distribution?
$$X_1 \dots X_n \sim f_\theta(x) = \begin{cases}
\exp(\theta-x) & x\geq\theta\\
0& otherwise
\end{cases}$$
We have
$$L_x(\theta) = \begin{cases}
\exp(n\theta-\sum_{i=1}^n x_i) & x_i\geq\...
1
vote
1answer
216 views
Deriving confidence intervals from a LOOCV of a GAM
Say that I have some observations, $y_1, y_2, ...y_n$ that are described using a generalized additive model (GAM). A Leave-One-Out Cross-Validation (LOOCV) is then performed where each observation $...
0
votes
0answers
94 views
sufficient statistic for n-point distribution that depends of one parameter
I'm studiying the concept of sufficient statistic, but I have a question that I can't resolve... I hope someone can help me.
My question is the next:
I suppose that I do n independent trials with m ...
3
votes
1answer
81 views
Does nonparametric bootstrapping work on correlated data?
I have $m$ weakly stationary observations $X_1,X_2,\cdots,X_m$ from a Markov chain. I want to estimate the variance of the mean. My idea was to use nonparametric bootstrapping to make $n$ bootstrap ...
1
vote
0answers
130 views
uniqueness of MVUE
Let $(X_1,...,X_n)$ be a random sample from an exponential distribution with
pdf $f(x,\theta) = \frac{1}{\theta}\exp{\frac{-x}{\theta}}I_{(0,\infty)(x)}$ , which of the following estimators is the ...
1
vote
1answer
332 views
Numerically computing the MLEs using Newton's method and the invariance proprty
I'm currently addressing maximum likelihood estimation for a three-parameter probability distribution with all parameters being positive real-valued. I'm using Newton's method to calculate the MLEs ...
2
votes
0answers
46 views
What should the estimated proportion be for the population when the sample proportion is 1?
I am auditing insurance claims for fraud. In my random sample, all the claims are fraudulent. Could I say for the population that the estimated proportion of fraud is 1? I know how to compute a ...
2
votes
0answers
41 views
Is it possible to have a point estimate outside of confidence interval? [duplicate]
Is it possible to have a point estimate outside of confidence interval? Could anyone give me an example?
2
votes
0answers
384 views
Find the UMVUE of $6\theta^2$ given $f(x|\theta) = \frac{1}{2\theta^2} e^{\frac{-\sqrt{x}}{\theta}} I_{(0,\infty)}(x)$
Given $X_1, X_2,\ldots, X_n$ are i.i.d rvs with pdf $f(x|\theta) = \frac{1}{2\theta^2} e^{\frac{-\sqrt{x}}{\theta}} I_{(0,\infty)}(x)$ for $\ \theta > 0$. Find the UMVUE of $\ 6\theta^2$, and ...
2
votes
2answers
216 views
MLE estimator of $P(X \leq c)$ for $X~ normal(\theta,1)$
I need to find MLE estimator of $P(X \leq c)$ where X is $Normal(\theta,1)$, c is fixed. Note: $X_1,...,X_n$ are a random sample drawn from $Normal(\theta,1)$
Any hint on how to approach this ...
3
votes
1answer
649 views
What is the difference between complete statistics and complete family of distributions?
I fail to understand when we call a family of distribution is complete and when a statistic is complete. What is the difference between both?, Is there a relation between them? Please provide examples ...
1
vote
0answers
30 views
Is there a method for comparing point estimates after determining an interaction effect?
Suppose I'm conducting a multiple regression with two predictor variables (X1 and X2) and have found a significant interaction effect.
Let's say X1 = aggression, X2 = gender (men/women), and Y = ...
2
votes
1answer
6k views
Parameter estimation of Gamma Distribution using R
This question might also be suited to the programming site, but I thought since there is enough on the statistics side, I would use this forum. I am trying to estimate the alpha parameter in a Gamma ...
0
votes
1answer
80 views
Statistics point estimation question
I have the following question, I am not sure how to interpret it.
Suppose we are interested in estimating the difference in true average mean length between the two species of fish. Calculate an ...
3
votes
0answers
311 views
Karlin-Rubin's theorem in the setting of the uniform distribution
Suppose that I have a population desribed by $X\sim U(0,\theta)$, where $\theta$ is unknown. I want to test $$\begin{cases} H_0:\,\theta\leq 30 \\ H_A:\,\theta>30\end{cases}$$ using the uniformly ...
0
votes
1answer
22 views
Choosing one parameterization over another
Suppose I have a random response Y and a fixed predictor X. My model is
\begin{align*}
Y &= \frac{aX}{b + aX}
\end{align*}
where $X, Y, a, b > 0$. I have a sample $Y_1, ..., Y_n$ and n is ...
0
votes
1answer
22 views
Obtaining group-level estimate of quantity, for e.g. correlation
say I have multiple estimates of correlation between source A and source B, for multiple subjects. the number of estimates vary between subjects. for example, subject 1 might have 10 estimates of ...
0
votes
1answer
46 views
Analysing the entire population [duplicate]
I am performing an analysis in which the unit of analysis is a geographical area (more precisely, an LSOA). This is a case when the sample analysed can represent the entire population (all 32000+ ...
