4
$\begingroup$

I am reading up on Hidden Markov Models (HMMs) for my research and would like to know if it is applicable to the problem I wish to tackle.

My problem is to detect/estimate the next value of a sequence of observations that comes from a finite alphabet. I think I can model the observations as coming from an HMM, as in I believe it is possible to devise a Markov chain where the probability distribution of the observation is only dependent on the current state and at each state a new observation is derived.

Now, supposing I formulate such an HMM, is it now possible to make use of the tools available for HMMs to predict the next observation or is it only useful to predict the next (hidden) state?

Improve this question
$\endgroup$
2
$\begingroup$

A HMM is usually comprised of a transition model $p(z_i|z_{i-1})$ and an observation model $p(x_i|z_i)$. It should be fairly easy to take the predictive distribution for hidden state $z_i$ and feed it through the observation model to get a distribution for the observation $x_i$.

For example, if $z_i$ were discrete and you'd found yourself a distribution $p(z_i)$ over the $i$th hidden variable, the $i$th observation would be distributed as

$$p(x_i) = \sum_k p(x_i|z_i = k )p(z_i = k)$$

This is called marginalization.

Improve this answer
$\endgroup$
  • $\begingroup$ Hi, thanks for the information. Can you elaborate as to how one can obtain the distribution $p(z_i)$? Is it possible to use available techniques in HMMs to get that? $\endgroup$ – lite-whowantstoknow Feb 9 '15 at 23:21
  • $\begingroup$ If you've got observations $x_1, \dotsc, x_n$ and you want to figure out $p(z_i|x_1, \dotsc, x_n)$, you want the forward-backward algorithm. If you want to figure out $p(z_i|x_1, \dotsc, x_i)$, you want the forward algorithm. Finally, if you want to deduce the parameters as well as the hidden states, you (probably) want the Baum-Welch algorithm. $\endgroup$ – Andy Jones Feb 10 '15 at 20:24

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.