0
$\begingroup$

Original Problem

I'm looking at problem-set in cs229 about EM algorithim.

enter image description here enter image description here enter image description here

As my understanding $\ell_{\text{semi-sup}}(\theta)$ is

$$ \ell_{\text{semi-sup}}(\theta) = \sum^m_{i=1} \log \sum_{z^{(i)}} p(x^{(i)}, z^{(i)}; \theta) + \alpha \sum^{\tilde{m}}_{i=1} \log p(\tilde{x}^{(i)}, \tilde{z}^{(i)}; \theta) $$

Where $\tilde{m}$ is the labelled examples.

My thought

Does my understand correct?

Objective means "to predict the correct label for newly presented input data", which means model is more accurate after which iteration.

Idea

Use derivative to show that the slope is decreasing or is there any another ways to prove that? Or just subtract two equations?

Then prove seperately that it converge for supervised and unsupervised?

Improve this question
$\endgroup$
2
  • $\begingroup$ Can you write out what $\ell_{semi-sup}$ is? It's hard to see what we're trying to prove otherwise. $\endgroup$
    – chang_trenton
    Aug 14 at 3:03
  • $\begingroup$ @chang_trenton, added thx $\endgroup$
    – Yiffany
    Aug 14 at 3:06

0

Reset to default

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.