I am reading/studying this paper 1 and got confused with some expressions. It might be basic for many of you, so my apologizes. In the paper the following prior model is assumed:
$\mu_k \sim \mathcal{N}(0, \sigma^2) \\ c_i \sim Categorical(1/K, ... 1/K) \\ x_i|c_i, \mu \sim \mathcal{N}(c_i^{T}\mu, 1)$
The joint density is modeled as follows:
$p(x, c, \mu) = p(\mu)\prod_{i=1}^{n}p(c_i)p(x_i|c_i, \mu)$
Using the mean-field approximation as,
$q(\mu, c) = \prod_{k=1}^{K}q(\mu_k; m_k, s_k^{2}) \prod_{i=1}^{n}q(c_i;\varphi_i)$
the authors arrive to the ELBO,
$ELBO(\textbf{m}, \textbf{s}^2, \varphi) = \sum_{k=1}^{K}\mathbb{E}[\log p(\mu_k);m_k, s_k^{2}] + \\ + \sum_{i=1}^{n}(\mathbb{E}[\log p(c_i);\varphi_i] + \mathbb{E}[\log p(x_i|c_i, \mu); \textbf{m}, \textbf{s}^{2}, \varphi_i]) + \\ - \sum_{i=1}^{n}\mathbb{E}[\log q(c_i;\varphi_i)] - \sum_{k=1}^{K}\mathbb{E}[\log q(\mu_k; m_k, s_k^{2})]$
I am kind of lost in how to compute the ELBO. E.g., the first term is the prior on $\mu_k$, which is a zero-mean Gaussian. Then I would say that term is zero. Am I right? In the second term, $\sum_{i=1}^{n}(\mathbb{E}[\log p(c_i);\varphi_i]$, should it be $\log (K)$? Can someone give me a hint how to compute this equation?
Besides this, the paper goes on presenting the update algorithm on page 14. The update equation for the latent variables $\varphi_i$ is:
For $i=1....n$
$ \varphi_{ik} \propto \texttt{exp}\{\mathbb{E}[\mu_k; m_k, s_k^{2}]x_i - \mathbb{E}[\mu_k^{2};m_k,s_k^{2}]/2\}$
Again, $\mathbb{E}[\cdot]$ is computed w.r.t. $q(\cdot)$, and, assuming that $\mu_k$ is a Gaussian distribution centered here at $m_k$, the first term should be simply $\texttt{exp}\{m_k x_i\}$ ? the second term just $\texttt{exp}\{(s_k^{2} + m_k^{2})/2\}$ ?
Help in understanding these expressions would be very appreciated! Thanks!