Questions tagged [method-of-moments]

A method of parameter estimation by equating sample and population moments then solving the equations for the unknown parameters.

48 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4
votes
0answers
43 views

Approximating standard error that contains a parameter, by replacing the parameter with its estimate

I am a bit confused about the following step I have seen in the stats literature which seems to me a bit circular. Say you are approximating the standard error of the MoM estimate of an exponential ...
4
votes
0answers
99 views

Identification Problem in Minimum Distance Estimation

I have the following problem with a system of minimum distance equations I want to solve. The objective is to estimate the parameters of the random variables in the following DGP: $$ x_t= \phi_t(\...
3
votes
0answers
141 views

Check Computation of MME and MLE

Let $X_1$, . . . , $X_n$ be i.i.d random variables having pdf $$f(x\mid\theta) = (\theta+ 1)x^{\theta}I_{(0,1)}(x)$$ where $\theta \gt−1$ (a) Give a MME of $\theta$ based on the first ...
3
votes
0answers
113 views

Discrete, finite L-moment problem

Suppose that we have a real-valued discrete random variable, whose probability distribution has finite support on some set $S$ of real numbers. Then if $N = |S|$, we know that we can construct the ...
3
votes
0answers
107 views

Does diagnolizing higher-order cross-moment matrices lead to independent variables?

Diagonalizing the covariance matrix transforms multivariate data into uncorrelated variables, but does not make them independent necessarily. Does it follow from this that if I were to diagonalize ...
3
votes
0answers
190 views

Method of moment estimator

Consider $U_i \sim^{iid} Bernoulli(\pi)$. Also consider: $$Y_i | U_i = 0 \sim exp(1/\gamma) \text{ and } Y_i | U_i = 1 \sim exp(1/2\gamma) $$ What are the method of moment estimators of $\pi \text{ ...
3
votes
1answer
981 views

Estimating parameters in a truncated negative binomial distribution?

I would like to find the estimates of the parameters in a truncated (at zero) negative binomial distribution. Suppose $Z$ has this distribution with parameters ($\alpha,\beta$). (The parametrization ...
2
votes
0answers
77 views

Confidence Interval for Estimator using Delta method

The statement I am given the following discrete distribution with $\theta>0$ $$p(x) = \left(\frac{\theta}{1+\theta}\right) ^{2-x}\left(\frac{1}{1+\theta}\right)^{x-1} \hspace{1cm} x=1,2$$ I need to ...
2
votes
0answers
42 views

Why methods of moments is not widely used in machine learning?

If I recall correctly, in most machine learning context I have encountered, only maximum likelihood estimation and maximum a posteriori method are used. Why not method of moments?
2
votes
0answers
51 views

Variance of the method of moments estimator for $\mu$ of log-normal distribution

Suppose the data has originated from a log-normal distribution with parameters $\mu$ and $\sigma$ (i.e. the mean and standard deviation of the underlying normal distribution). I have only the sample ...
2
votes
0answers
90 views

Method of moments as non-parametric model

In Wikipedia article (https://en.wikipedia.org/wiki/Nonparametric_statistics) about nonparametric statistics there is "Method of moments (statistics) with polynomial probability distributions&...
2
votes
0answers
73 views

a question about method of moment estimator

I have a question about method of moment estimator. Say I have a IID sample $X_1, X_2, ..., X_n$ from an exponential distribution $Exp(\theta$), say I want to find the method of moment estimator of $...
2
votes
0answers
28 views

Estimated Standard Error of a Method of Moment Estimator, Poisson Example

For X randomly sampled from a Poisson(lambda) population, the method of moment estimate of lambda is the sample mean: lambda_hat = X_bar Now, say we are interested in the variance of lambda_hat (...
2
votes
0answers
385 views

Solving a system of equation by moment condition reports error but minimum distance works

I do not understand the following error message I get using the gmm function in R. The code below creates two moment conditions (...
2
votes
0answers
78 views

Numerical method to compress empirical probability distribution

I am trying to grapple with the following problem. I have an application that develops empirical distributions. In essence, I end up with a histogram of equally spaced $x$ values, with both a $max$...
2
votes
0answers
267 views

Covariance of parameter estimates in Method of Moments

I have a $3\times1$ vector function $f(x_i;\theta)$ where $X$ is a rv and $\theta$ is $3 \times 1$ parameter vector, such that \begin{equation} E \, f(X;\theta) = {\bf 0}.\end{equation} If I have a ...
2
votes
0answers
722 views

When is the MLE equivalent to the MM estimator

I know that in natural exponential families the general method of moments estimator we get from working with the sample and the sufficient statistic gMM is equivalent to the maximum likelihood ...
2
votes
0answers
543 views

Degrees of freedom of J-Test distribution

This book states, on page page 256 ( the GMM section) that the J-test(for over-identifying restrictions) is of the following form $G_n'J_n^{-1}G_n \approx \chi^2(m-p) $, where $G_n=G_n(\theta)=1/n \...
2
votes
0answers
2k views

Estimating the parameters of a beta distribution with zeroes and ones in the sample

I have a list of values in [0,1] that I want to fit to a Beta distribution in order to get the corresponding alpha parameter. I can't use a beta fitting function because my values might be 0's and 1'...
1
vote
0answers
27 views

Discuss that method of moment estimation is inefficient

Discuss that method of moment estimation is inefficient. Then model is Consider the following linear model $$y_t = x_t' \beta +u_t$$ where $t =1,...,T$ and $x_t = (x_{1t} x_{2t} ... x_{kt})'$ , $ \...
1
vote
0answers
33 views

Can we use pooled ols on dynamic panel without individual fixed effect (but with group fixed effects) and no serial correlation in error

Is it correct that dynamic panel without individual fixed effect (but with group fixed effects), no serial correlation in error can be estimated consistently through pooled ols? For example, suppose ...
1
vote
0answers
46 views

why is method of moments estimates asymptotically normal

I have noticed that a lot of statistics textbooks contain lengthy discussions and detailed proofs on showing that MLE estimates are asymptotically normal (under regularity conditions). On the other ...
1
vote
0answers
243 views

Method of Moment Estimator — Uniform Dist

Find the two method of moment estimators for $\theta$ given that $Y_i | \theta$ is distributed i.i.d U(0,$\theta$). We know that E($Y_1$) = $\frac{\theta}{2}$ and Var($Y_1$) = $\frac{\theta^2}{12}$ ....
1
vote
0answers
65 views

Can I use the method-of-moments estimator to get the adjustment factor for a generic transformation of the regressand?

When the regressand is in logarithmic form, the model looks like this: $$log(y)=X\beta+u$$ When we are ultimately interested in predicting $y$, we cannot simply use $exp(X_0\hat\beta)$ as a ...
1
vote
0answers
366 views

approximate a probability distribution by moment matching

I have a 60-40 weighted distribution, of uniform(0,7.5) and uniform(7.5,10) respectively, i.e. $$f_X(x)=(0.6/7.5)1_{x∈[0,7.5)}+(0.4/2.5)1_{x∈[7.5,1]}$$ I have worked out that $$E(X) = 0.6(7.5/2) + ...
1
vote
0answers
281 views

Is it possible to calculate mutual information by moments generating functions?

I went to listen to a workshop and some audience asked the presenter how the moments can improve the mutual information. I am learning the MI(Mutual Information) and moments so don't have enough ...
1
vote
0answers
188 views

How do I apply the method of moments for estimating parameters in a sum-relationship?

We have a model relationship between three random variables like this: $$ U = C + S $$ I have a ton of measurements of realizations of $U$, as well as a ton of realizations of $C$. But the ...
1
vote
0answers
976 views

Why doesn't the method of moments work when calculating the variance of the inverse gamma distribution?

I'm trying to calculate the variance of the inverse gamma distribution using the method of movements. According to wikipedia the variance should be: $$\sigma^2 =\frac{\beta^2}{(\alpha-1)^2(\alpha-2)}$...
0
votes
0answers
23 views

When is the Optimal weighting matrix in GMM singular?

currently I am trying to estimate a simple linear regression: \begin{equation} y_t = X \beta + \varepsilon_t, \end{equation} where I try to find 4 coefficients and one specific predictor is an ...
0
votes
0answers
14 views

Is this correct for (generalised) method of moments?

I am reviewing a MOOC and realised... I didn't grasp the method of moments, so I did try to get it back "from scratch". Are the above equations/sentences correct ? In the MOOC the analysis ...
0
votes
0answers
15 views

advantage of mcmc over method of moments?

When I want to estimation parameter of beta distribution and I have large amount of samples, what would be the advantage of using MCMC over calculating these two parameters (alpha and beta) of beta ...
0
votes
0answers
54 views

MSPE predictor of MA model

Assume $e_i=(\epsilon_i+\epsilon_{i+1})/2, i=1,...,n$ where $\epsilon_1,...,\epsilon_{n+1}$ are iid with mean zero and variance $\sigma^2$. Then $e_i$ are the moving average errors. Now, consider the ...
0
votes
0answers
45 views

Fixed repeated sampling

Suppose we are dealing with a linear regression $𝔼[𝑌𝑖|𝑋𝑖]=\beta_0+\beta_1X_𝑖$ The distribution of $X_i$ is fixed in repeated samples. $\epsilon_i$ follows an unconditional i.i.d. normal ...
0
votes
0answers
32 views

Finding the Method of Moments in two Parameters

Let $X_1, X_2, \ldots, X_n$ be a random sample of size $n$ from the following distribution $$f(x;\mu, \lambda) = \sqrt{\frac{\lambda}{2\pi x^3}}e^{\frac{-\lambda(x - \mu)^2}{2\mu^2 x}}$$ where $x, \...
0
votes
0answers
26 views

Method of Moments Estimators

Let $X_1, \ldots, X_n$ be a random sample of size $n$ from the following distribution: $$f(x) = \frac{1}{\theta_2}e^{-\frac{(x - \theta_1)}{\theta_2}}, \;\; x\geq \theta_1, \;\; (\theta_1,\theta_2)\in\...
0
votes
0answers
47 views

Asymptotic distribution of mme of coefficient of variation

For random sample from unif(0,1) distribution, method of moments estimator for coefficient of variation is sample mean divided by sample standard deviation. Here, coefficient of variation theta is mu/...
0
votes
0answers
35 views

Higher moments of Lognormal Distribution

I am experiencing a weird problem modeling lognormal distributions and I am quite stuck on this one. For a normal distributed variable X following a $N(\mu,\sigma^2)$ distribution, we have that $Z=e^...
0
votes
0answers
71 views

Moments method and plug-in method

We have the following discrete distribution on $\{1,2,3\}$: $$\mathbb{P}(X=1)= \theta^2, \mathbb{P}(X=2) = 2\theta(1-\theta), \mathbb{P}(X=3)=(1-\theta)^2$$ with $\theta \in (0,1)$ and want to use ...
0
votes
0answers
79 views

Method of moment through covariance derivation

Given a Bivariate INAR(1) Poisson Process: $Y_t^1 = \rho_1 * Y_{t-1}^1+R_t^1$ $Y_t^2 = \rho_2 * Y_{t-1}^1+R_t^2$ Where $R_t^1$ and $R_t^2$ are the innovation terms and follow the bivariate Poisson ...
0
votes
0answers
24 views

How to derive the distribution of OLS starting from the sample moments?

I know I am supposed to start from $N^{1/2}[N^{-1}\sum x_{i}u_{i}]$ Then by central limit theorem that that it is asymptotically $ N(E(x_{i}u_{i}),var(x_{i}u_{i})) $ and $E(x_{i}u_{i})=0$ so $ ...
0
votes
0answers
34 views

Suggesting a method of moments estimator for the chance that some event happens

Let $X_i$~ $\text{Pois}(\lambda)$ be the number of breakdowns a certain ATM machine experiences in the $i^{th}$ week. $\implies$ Let $ \{X_i\}_{i=1}^n$ be iid of the number of breakdowns the machine ...
0
votes
0answers
21 views

Method of moments giving super sensitive estimates

I'm trying to study a process that produces, in theory, an equilibrium distribution where the $i$th raw moment is given by: $$ \mu_i = \exp(-\theta_1 \sum_{j=0}^{i-1}(1 + j\theta_2)^{-\theta_3}) $$ ...
0
votes
0answers
54 views

How does a method of moments estimate compare with a true value of the parameter?

To cut the long story short, I've been given this information: pdf:$$f_X=\tau xexp\left({\frac{-\tau x^2}{2}}\right)$$ $x,\tau>0$ I went ahead and found the cdf:$$F(X)=1-exp\left(\frac{-\tau x^2}{2}...
0
votes
0answers
244 views

Understanding the Method of Moments

This is an understanding question regarding the method moments: It's basic idea is that any $k^{th}$ moment $m_{k}$ converges in probability to its empiric estimator as follows: $$m_{k} = \frac{1}{n} ...
0
votes
0answers
144 views

Distribution that has shape of normal and uniform distribution

I have a pdf of a random variable that looks like image below (the support is $[-1,1]$). It is actually function of another random variable, let's say $T = aX + bY + cZ$. When I changed parameters $(a,...
0
votes
0answers
503 views

Confusion about using moment condition in a multiple regression model

The very simple case assumes that we have a model like $y = a + bx + e$ where the condition $cov(x,e)=0$ is true. Hence one can use the relationship of the moment conditions to estimate the parameter $...
-1
votes
1answer
60 views

Find the Method of moments estimate

So here i am getting E(X)=1/2,E(X^2)=0 and E(X^3)=Theta squared/4 How do i proceed now?How do i use the given x values ?
-1
votes
1answer
578 views

Matching moments in Gaussian Mixtures

Consider $$q^{\backslash n}(\theta) = \mathcal{N}(\theta | m^{\backslash n},v^{\backslash n}I)$$ and $$f_n(\theta) = (1-w)\mathcal{N}(x_n | \theta,I) + w\mathcal{N}(x_n|0,aI)$$ Then let $$\hat{P}(\...