Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

Is it correct to say that the Hidden State Sequence in a Hidden Markov Model is a Markov Chain?

Thanks

share|improve this question
add comment

2 Answers 2

up vote 2 down vote accepted

Yes, it's definitely a Markov chain because the observed variables define the transition probabilities from every latent variable configuration to every other. (That is, they yield an $n \times n$ matrix of probabilities where $n$ is the number of latent variable configurations.)

Usually you can say more about the Markov chain:

If you're talking about Boltzmann machines, for example, then the Markov chain you get from iterating the variables is time-homogenous since time doesn't matter. This would also be true in a regular Markov model if you were to hold the observed nodes fixed.

For Boltzmann machines, you also have ergodicity since all states are positive recurrent (for finite weights). You can often have the same property for a Markov model.

If you have an ergodic, time-homogenous Markov chain, then the network converges to a steady state distribution.

share|improve this answer
add comment

Yes, A hidden Markov model is a bivariate stochastic process $\{(X_t,Y_t)\}_{t\geq0}$, defined on a product space $(\mathsf{X} \times \mathsf{Y},\mathcal{X} \otimes \mathcal{Y})$, where $\{X_t\}_{t\geq0}$ is a Markov chain taking values in $\mathsf{X}$ and $\{Y_t\}_{t\geq0}$, defined on some state space $\mathsf{Y}$, is a sequence of observable random variables conditional on $\{X_t\}_{t\geq0}$.

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.