Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 54458

a method of estimating parameters of a statistical model by choosing the parameter value that optimizes the probability of observing the given sample.

1 vote

$N(\theta,\theta)$: MLE for a Normal where mean=variance

Consider $\log f(x) = -0.5\log (2 \pi \theta) - 0.5 \frac{(x - \theta)^2}{\theta}$ and $$ \frac{\partial}{\partial\theta} \log f(x) \propto -\frac{1}{\theta}+\frac{x^2}{\theta^2} -1 $$ Thus, $$ \frac{ …
Hunaphu's user avatar
  • 2,238
1 vote

MLE phi derivation

$L(\phi) = \prod p(x_j, y_j; \phi)$ So $\log L = \ell(\phi) = \sum \log p(x_j, y_j; \phi)$ Since $p(x\mid y)$ does not depend on $\phi$, $p(x, y) = p(x \mid y)p(y) \propto p(y)$ so $\frac{d}{d\phi} \l …
Hunaphu's user avatar
  • 2,238
4 votes

Should the likelihood function be increasing in every step of the EM algorithm?

Perhaps not relevant in this case but note that if the E-step is estimated, with Monte Carlo methods or another approximation, it is possible for the likelihood to decrease. A thought that might be r …
Hunaphu's user avatar
  • 2,238
0 votes

Maximization of a nasty Gaussian likelihood

In the plots below the result from the code is plotted. The first plot show loglikelihood, the second shows the x-estimate and the third shows the error compared to x. I used logmvnpdf found here: htt …
Hunaphu's user avatar
  • 2,238
2 votes

Is this a typo on P.75, Theorem 5.52 of the book "Asymptotic Statistics" by Van der Vaart?

First point: Since $d(\theta, \theta_0)<\delta$ it should be possible to select $\theta = \theta_0$ which gives $\sup=0>-C\cdot0^\alpha$. Without being specific for this problem, if $x^*=\arg\max a(x) …
Hunaphu's user avatar
  • 2,238
4 votes

Estimating the parameter $\beta$

$ L(\beta) = P(\mathrm{Data} \mid \beta) = \prod_i f(x_i) $ and $\lambda = \frac{1}{\mu} = \frac{s}{\beta}$ Log is increasing so maximizing log is same as maximizing likelihood: $\ell(\beta) = \sum \l …
Hunaphu's user avatar
  • 2,238