1
$\begingroup$

I'm trying to determine the MLE of $\lambda$ in a Poisson distribution using R. I'm aware that the MLE is $\hat{\lambda}=\bar{x}$ but I want to demonstrate this using Rmarkdown. My experience with R code is limited and I wish to learn how to do this, but all reference material I have found involves actually generating frequencies and such which I do not wish to do. Are there any references for learning how determine the MLE in R without making use of a sample of data?

$\endgroup$

closed as off-topic by jbowman, Ben, Michael Chernick, mkt, Jarle Tufto Apr 17 at 8:11

This question appears to be off-topic. The users who voted to close gave this specific reason:

  • "This question appears to be off-topic because EITHER it is not about statistics, machine learning, data analysis, data mining, or data visualization, OR it focuses on programming, debugging, or performing routine operations within a statistical computing platform. If the latter, you could try the support links we maintain." – jbowman, Ben, Michael Chernick, mkt, Jarle Tufto
If this question can be reworded to fit the rules in the help center, please edit the question.

  • $\begingroup$ In the formulation of a maximum likelihood estimator you begin by assuming that you have a sample of iid random variables from the distribution in question. So to use R to get the MLE of $\lambda$ you would first need a sample of Poisson distributed data; whether that was generated or is data you already have and is considered Poisson under your model assumptions. $\endgroup$ – Mr. Wayne Apr 17 at 3:00
3
$\begingroup$

Well, if there's no data involved then it seems like a pen and paper would do the trick, since the MLE will be the same no matter what. I don't think R will prove very useful to you, but it would be easy to show your calculations in Rmarkdown. Here's what it could look like:

"The PMF for the Poisson distribution is as follows: $$\frac{\lambda^xe^{-\lambda}}{x!}$$ We want to find the estimate for $\lambda$ that is most likely given the data. The joint PMF for the data (assuming independent observations) is: $$\Pi_{i=1}^{n}\frac{\lambda^{x_i}e^{-\lambda}}{x_i!}$$ when there are $n$ observations. This is the likelihood. It will be easier to find the value of $\lambda$ that maximizes this quantity if we take the log: $$\log (\Pi_{i=1}^{n}\frac{\lambda^{x_i}e^{-\lambda}}{x_i!}) = \sum_{i=1}^{n}\log(\frac{\lambda^{x_i}e^{-\lambda}}{x_i!}) = \sum_{i=1}^n x_i\log(\lambda) - \sum_{i=1}^n \lambda - \sum_{i=1}^n \log (x_i!)$$ $$=\log(\lambda)\sum_{i=1}^nx_i - n\lambda - \sum_{i=1}^n \log (x_i!)$$ To find the value of $\lambda$ that maximizes this equation, we take the derivative, set the derivative equal to zero, and solve for $\lambda$: $$0 = \frac{1}{\lambda}\sum_{i=1}^nx_i - n$$ $$n\lambda = \sum_{i=1}^n x_i$$ $$\lambda = \frac{\sum_{i=1}^n x_i}{n} = \bar{x}$$"

The syntax used to produce this is:

The PMF for the Poisson distribution is as follows: $$\frac{\lambda^xe^{-\lambda}}{x!}$$ We want to find the estimate for $\lambda$ that is most likely given the data. The joint PMF for the data (assuming independent observations) is: $$\Pi_{i=1}^{n}\frac{\lambda^{x_i}e^{-\lambda}}{x_i!}$$ when there are $n$ observations. This is the likelihood. It will be easier to find the value of $\lambda$ that maximizes this quantity if we take the log: $$\log (\Pi_{i=1}^{n}\frac{\lambda^{x_i}e^{-\lambda}}{x_i!}) = \sum_{i=1}^{n}\log(\frac{\lambda^{x_i}e^{-\lambda}}{x_i!}) = \sum_{i=1}^n x_i\log(\lambda) - \sum_{i=1}^n \lambda - \sum_{i=1}^n \log (x_i!)$$ $$=\log(\lambda)\sum_{i=1}^nx_i - n\lambda - \sum_{i=1}^n \log (x_i!)$$ To find the value of $\lambda$ that maximizes this equation, we take the derivative, set the derivative equal to zero, and solve for $\lambda$: $$0 = \frac{1}{\lambda}\sum_{i=1}^nx_i - n$$ $$n\lambda = \sum_{i=1}^n x_i$$ $$\lambda = \frac{\sum_{i=1}^n x_i}{n} = \bar{x}$$"

$\endgroup$
  • $\begingroup$ Thanks, this cleared things up for me. I was just confused on what I was actually being asked to do but I appreciate the thorough answer! $\endgroup$ – Xtrfyable Apr 17 at 7:03
  • $\begingroup$ @Nick Cox Thanks. I didn't know about that one. I will edit my answer. $\endgroup$ – dante Apr 17 at 14:00
1
$\begingroup$

If $n = 10$ and $T = \sum_{i=1}^n X_i = 85,$ then the likelihood is proportional to $\lambda^T e^{-n\lambda}.$ The likelihood function is maximized at MLE $\hat\lambda =T/n= 8.5,$ as illustrated in R:

n = 10;  t = 85;  lam = seq(1, 15, by=.01)
like = dpois(t, n*lam)
plot(lam, like, type="l", lwd=2)
  abline(v = 8.5, col="red")

lam[like==max(like)]
[1] 8.5                # MLE

enter image description here

By contrast, if $n=100, T = 887,$ then $\hat \lambda = 8.87.$ There is more data, so the likelihood function near $\hat \lambda$ is more tightly curved, and the estimate is less variable.

n = 100;  t = 887;  lam = seq(1, 15, by=.01)
like = dpois(t, n*lam)
plot(lam, like, type="l", lwd=2)
  abline(v = 8.87, col="red")

lam[like==max(like)]
[1] 8.87

enter image description here

$\endgroup$

Not the answer you're looking for? Browse other questions tagged or ask your own question.