0
$\begingroup$

I am learning statistics for Machine Learning and have to answer to this basic question from the following extract: "Imagine a machine learning class where the probability that a student gets an 'A' grade is P(A) = 1/2, a 'B' grade P(B) = another, a 'C' grade P(C) = another, and a 'D' grade P(D) = another. We are told that 14 students get a 'C' and 28 students get a `D'. Our goal is to obtain a maximum likelihood estimate of another.

b) Assume now we don't know how many students got exactly an 'A' or exactly a 'B'. But we do know that 49 students got either an A or B. Therefore, a and b are unknown values where a + b = 49. Write the function to be optimized under the MLE."

I think I managed to calculate the first MLE for the given sample, but I do not quite understand how can I do it without knowing the values of 'a' and 'b' and cannot seem to figure out how to solve it using Bayes' Theorem.

$\endgroup$
1
  • $\begingroup$ keep in mind that $p(A\text{ or }B)=\frac{1}{2}+\mu$ $\endgroup$
    – PedroSebe
    Commented Oct 4, 2020 at 18:29

1 Answer 1

1
$\begingroup$

The full likelihood, based on the complete data, is $$ L(\mu)=(\frac12)^a \mu^b (3\mu)^c (\frac12-4\mu)^d $$ But you only know $a+b$, then we make a likelihood using that $P(a ~\text{or}~ b)= \frac12+\mu$, giving the observed-data likelihood $$ L^*=(\frac12+\mu)^{a+b} (3\mu)^c (\frac12-4\mu)^d. $$

$\endgroup$
1
  • 1
    $\begingroup$ +1 This results in $\hat{\mu} = \frac{1}{8} \left(\sqrt{3}-1\right)$ and the approximate variance being $\frac{3-\sqrt{3}}{3584}$. $\endgroup$
    – JimB
    Commented May 30 at 18:15

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.