Any statistical process which seeks to approximate an unknown value, such as a distribution, a point estimate (e.g. mean), or confidence interval.

learn more… | top users | synonyms

0
votes
0answers
18 views

Least mean square algorithm – conceptual doubt

I have used the least mean square (LMS) algorithm to estimate a signal in the presence of high chaotic and random noise. MSE values in db at each SNR for the coefficients is positive even though I ...
5
votes
1answer
25 views

Restoring original distribution from noisy observations

There is a known set of pairs $(y_i, \sigma_i)$ such that $y_i = x_i + \sigma_i N_i$ $N_i \sim \mathbf{N}(0,1) $ for all $i$ $x_i \sim \rho$ for all $i$ where $y$ is observed value, $x$ is true ...
0
votes
1answer
31 views

Difference between estimation and learning

What is the difference between parameter estimation which includes system identification and learning in machine learning perspective? Let say the model is y= Ax. x is the input and y is the output. ...
0
votes
0answers
22 views

Geographic regression

I'm working on a project to estimate real estate and started with some classique techniques, such as linear regression etc. The obtained results are already going in the good direction, but to get ...
0
votes
1answer
40 views

Estimation of AR(1) process

Suppose the stochastic process ${X_t}$ satisfies the equation $$X_t=\phi X_{t-1} + Z_t \tag{A}$$ where $\phi>1$ and $Z_t$ is a white noise. Then iterating forward we get that the only stationary ...
0
votes
0answers
10 views

Parameter estimation of gaussian function kernel using cross-validation

I need to estimate (using cross-validation), the parameters $\sigma$ and $\lambda$ of the Gaussian kernel: $K_G(x,y) = \sigma^2 \exp{(-\frac{1}{2\lambda^2}\sum_{i,j}(x_{ij}-y_{ij})^2})$ where $x$ ...
2
votes
2answers
79 views

Which distribution for modelling duration of tasks?

Recently I was present with a task estimation technique. Instead of letting people rate a task for x - amount of hours, I let them discretize tasks into discrete sizes like small / medium / large / ...
0
votes
0answers
23 views

Intuition behind the Stein's paradox

I had read wiki and some sources. jmanton's blog, Wasserman's blog the background is that: You have Xi ∼ N(θi, 1), and we want to estimate the each θi. Where Xi are ...
0
votes
1answer
18 views

Covariance estimation

Suppose I want to estimate the covariance of $n$ $p$-dimensional iid random vectors $X_i$, where $n>p$. I've read in several places that if $n-p$ is small then the MLE covariance matrix estimate ...
1
vote
2answers
35 views

Why representation of AR process comes up in estimation

Let ${X_t}$, $t=...-2,-1,0,1,2...$ be a stochastic process that satisfies: $X_t=\rho X_{t-1}+\varepsilon_t$ with $|\rho|<1$ and $\varepsilon_t$ is a white noise. In that case, we also know that ...
0
votes
1answer
24 views

Why does maximum likelihood estimation not work in estimating signal in deterministic chaotic noise

I have few conceptual questions related to application of chaos in communications. In few application such as radar Chaotic signal reconstruction with application to noise radar system, cryptography, ...
0
votes
0answers
24 views

Estimating number of unique people

Assume from a prior experiment with have a known truth table of misclassification of logins on an individual basis. $$ \begin{array}{c|lcr} \text{Truth}/\text{Observed} & \text{Al (M)} & ...
1
vote
1answer
22 views

What is the difference between ex ante and a priori, if any?

In the context of estimating geophysical quantities from remotely sensed data (inverse theory), what do the terms ex ante and ex post mean? For context, see for example this paper by T. von Clarmann ...
1
vote
0answers
15 views

Unbiased Estimator of Days Until Completion?

I'm trying to get an estimate of average number of days until some event occurs (the event is guaranteed to eventually occur). I have some sample where this event has already occured for most ...
-1
votes
0answers
15 views

Probability of 'Chance of winning' given a set of wins [closed]

Let $p$: chance of success and $q = 1-p$ Then given that there are m wins of the n games. What is the probability that p>q. Assuming p is normally distributed.
5
votes
1answer
39 views

In inverse theory, how do I transform the averaging kernel matrix to a new grid?

Rodgers and Connor (2003) describe how measurements by remote sounders can be properly compared, taking into account differences in averaging kernels and error covariances. They make the assumption ...
2
votes
1answer
30 views

variance of doubly truncated binomial

I am in need of variance of doubly truncated binomial distribution (equation number 3.69 on page number 137 of third edition of Johnson, Kemp and Kotz Discrete Probability Distributions). Thanks. ...
0
votes
0answers
8 views

Estimating Distribution from Intervals

Say that I get an attendance list of people in a party. From another source I know the minimum and maximum age of each person with a name e.g. "John" must be between 19 and 55 or "Mary" must be at ...
0
votes
0answers
13 views

Efficient scale & shape parameter estimation for generalized secant hyperbolic distribution needed

the (symmetric) generalized secant hyperbolic distribution GSHD is very flexible but I found not much at all on how to estimate its 3 parameters. Given the location, I need to obtain scale & shape ...
1
vote
0answers
20 views

Maximum Likelihood through a noisy channel

I have a random variable $X$, which can take $n$ values and is distributed according to multinomial $\Theta=(\theta_1, \theta_2, \cdots, \theta_n)$. I observe a random variable $Y$, where I have that ...
0
votes
1answer
34 views

Question about using a multiplicative dummy variable

In many econometrics model, the changes in the response variables in certain intervals are more difficult than other intervals. But I believe this is often not considered when estimating the model. ...
0
votes
1answer
41 views

Predicting the impact point of a moving object

Suppose we have a moving object (a horizontal projectile motion as one of the most basic examples). Is there any way to predict where it will hit finally? Please note that I'm looking for a machine ...
1
vote
1answer
10 views

Parameters estimation of non-stationary random process using different runs

Let $X(t)$ be a non-stationary continuous time-dependent random process with a known model but unknown parameters. I'd like to know if it's possible to estimate the parameters of $X(t)$ not by using ...
2
votes
0answers
35 views

Estimating a joint distribution from observed max and min samples

Suppose that you have jointly distributed $N$ (~100) random variables, $\{X_1,\ldots,X_N\}$, and this distribution is unknown to you. However you do know that their sum is zero by construction. Having ...
0
votes
0answers
31 views

Maximum likelihood estimator for variance in two linear models

I am learning MLE's at my inference class and this is a problem I came accross. Consider two simple linear models. $y_{1j}=\alpha _1+\beta_{1}x_{1j}+\epsilon_{1j}$ and $y_{2j}=\alpha ...
1
vote
1answer
120 views

Estimate average percentage error based on another gaussian measurement

I have a model where the error is proportional to the throughput. This is, the observations I got come from a measurement instrument that has some error and it measures material going through in ...
2
votes
0answers
28 views

UMVUE for normal distribution $\sigma$

Let $X_1,X_2,...,X_n$ be a random sample from a normal distribution with mean $\mu$ and variance $\sigma^2$. I showed that $(\bar X,S^2)$ is jointly sufficient for estimating ($\mu$,$\sigma^2$) where ...
0
votes
1answer
18 views

Partial Parameter Estimation (MLE/LMMSE)

I have a basic question. MLE/LMSSE is introduced as follows: $$Y = H\theta + W$$ where $H$ is the linear model matrix, $W$ is measurement noise (let's assume it is normal so MLE = LMSSE). $\theta$ is ...
0
votes
2answers
23 views

Pivotal to estimate lambda of a exponential

I am studying interval estimation by the method of pivotal quantities. Let $X_1,X_2,...,X_n$ be a random sample from a p.d.f $f(x;\lambda)=\lambda e^{-\lambda x}, x>0,\lambda >0$. I have to ...
0
votes
1answer
88 views

Advantage of Maximum Likelihood estimation [closed]

We can estimate unknown parameters by Least square, Least Mean Square, Blue estimators and Maximum Likelihood estimation. Q1: What is the advantage of MLE over others and when should MLE be chosen? ...
3
votes
1answer
39 views

Would two different pivotal quantities of the same parameter give the same confidence interval?

I couldn't think of an example but it would be great if someone could give one.
2
votes
0answers
48 views

Confidence interval for the standard deviation of a Normal distribution with known mean

Suppose $\textbf{Y} = (Y_{1}, ... , Y_{n})$ is a random sample from the $N(\mu, \sigma_{0}^{2})$ distribution where $\mathrm{E}(Y_{i}) = \mu$ is unknown but $\mathrm{SD}(Y_{i}) = \sigma_{0}$ is known. ...
1
vote
0answers
50 views

Good Reading/Bibliography

Before posting this question, I searched CV for a similar question that could helped me, but I didn't find one. So, I'm sorry if this has already been asked before. So, I'm self-studying from Keith ...
3
votes
1answer
63 views

Cramer-Rao bound for $\chi^2$ distribution parameter estimates

I've struck an unpleasant problem with the noncentral $\chi^2$ distribution. I work with random variables, distributed as $\chi^2_{\nu}(\lambda)$, where $\nu$ is the degree of freedom and $\lambda$ ...
0
votes
1answer
29 views

Standard error of difference of estimates

I have two (non-independent) OLS-parameter estimates each with its own standard error. I'm trying to find out what the standard error of the difference of the estimates should be. Can anyone help? Is ...
0
votes
0answers
25 views

Estimation of Noise Level in the High-Throughput Cancer Data

Assume that I have made a coverage log ratios signal by dividing the coverage data coming from a tumour sample over the reference sample and then taking the log2 of this division. My question is: ...
2
votes
1answer
56 views

Estimating ARMA equation using lm() in R

Is there a way to estimate an ARMA equation using the lm() function in R without using arima()?
4
votes
1answer
165 views

Parameter estimation based on MLE estimate of another parameter

There is a situation explained below where I intend to apply MLE. The problem statement is that I am estimating a measure $X$. This measure is obtained my Maximum Likelihood estimation technique. ...
3
votes
1answer
46 views

Estimates of regression coefficients are uncorrelated?

Consider a simple regression (normality not assumed): $Y_i = a + b X_i + e_i$ where $e_i$ is with mean 0 and standard deviation $\sigma$. Are the Least Square Estimates of $a$ and $b$ uncorrelated?
0
votes
0answers
22 views

Biased but consistent estimator for the mean of Gaussian distribution?

$(X_1,X_2,\ldots,X_n)$ is a random sample from $\mathrm{N}(θ, 1)$. We know sample mean is a unbiased estimator that is consistent. What would be a biased but consistent estimator for θ? Would it be ...
1
vote
0answers
24 views

Relative importance of variables?

The following output is given: The task is to state, which variables, among thoses that are statistically significnat at 0.05, have the greatest and least relative importance on the fitted model? ...
2
votes
1answer
22 views

Estimate Mean and Standard Deviation from Percentiles

I have a derived dataset that specifies the percentiles from the 10th to 95th in increments of 5 along with the total number of data points. Is there a way to estimate the mean of the original ...
0
votes
0answers
41 views

temperature prediction algorithm

I found an interesting problem in a contest on temperature prediction: https://www.hackerrank.com/contests/expansion-challenge/challenges/temperature-predictions It is not about forecasting the ...
0
votes
0answers
21 views

G/G/1 Simulation help

i am a complete nooby in statistics, therefore the question i am about to ask may sound very unprofessional warning :) so, we have a task to simulate a G/G/1 queueing system for particular parameters ...
2
votes
0answers
56 views

Estimating means of correlated distributions with long tails

Suppose I have a relatively large number of samples (~1k) drawn from a series (~40) of increasingly long-tailed distributions (going from approximately normal to approximately log-normal). I want to ...
3
votes
1answer
68 views

Estimating Uniform distribution endpoints using data with errors

Suppose I have a random variable $X$ ~ $Unif(0,\theta)$ where I want to estimate $\theta$. I draw a sample $X_1,...,X_n$.One way is to get a point estimate using e.g. maximum likelihood estimation ...
2
votes
1answer
35 views

Estimate median from mean, std dev, and/or range

I have easy access to the the mean, standard deviation and min/max values for a variable. I also have the number of elements used to compute those values. The data is real numbers with an absolute ...
4
votes
1answer
99 views

Computing inverse probability weights — conditional (multivariate) density estimation?

The general version: I need to estimate $f(A | X)$ where $A$ and $X$ are continuous and multivariate. I'd rather do it nonparametrically because I don't have a good functional form in mind and ...
0
votes
0answers
20 views

Estimator for vectors(matrices) with increasing length

I'm now preparing exams for mathematical statistics. Our teacher told us that there will be problems concerning the estimator for vectors(or matrices) that increases length when the number of samples ...
1
vote
0answers
8 views

Estimating distribution of traffic across all Web pages

The web is estimated to have approx 5 billion web pages ( http://www.worldwidewebsize.com/ ). How would you go about estimating a CDF to know how many pages are required that make up, say, 90% of ...