Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 17096

Hidden Markov Models are used for modelling systems that are assumed to be Markov processes with hidden (i.e. unobserved) states.

2 votes
Accepted

How to handle new observations on HMM decoding?

The problem you're referring to, often called data sparsity, arises often in language modeling. In particular, if some vocabulary words don't appear in your training corpus then maximum likelihood te …
jerad's user avatar
  • 1,259
16 votes

Definition of dynamic Bayesian system, and its relation to HMM?

I'd recommend looking through these two excellent review papers: An Introduction to Hidden Markov Models and Bayesian Networks by Zoubin Gharamani Dynamic Bayesian Networks by Kevin Murphy HMMs …
jerad's user avatar
  • 1,259
1 vote

HMM a posteriori probs for hidden states and more

To get a distribution over the hidden state sequence use the forward-backward algorithm rather than viterbi. Regarding the problem of inferring too many 1s in your hidden sequence, you should think …
jerad's user avatar
  • 1,259
4 votes
Accepted

Mathematics needed to understand Hidden Markov Models?

Basic probability theory (i.e. when to sum versus multiply probabilities) is the only essential requirement. For Bayesian HMMs you would of course need to understand Bayesian inference, but HMMs do n …
jerad's user avatar
  • 1,259
1 vote
Accepted

Training Hidden Markov Models for multiple input observations

In that case, you would typically add a special "start" and "stop" symbol to the beginning and end of each sequence, and then concatenate them. Then define a special start and stop state which only ou …
jerad's user avatar
  • 1,259
2 votes
Accepted

Initial Probabilities of an HMM

If you're training the HMM on one long string then it only has one example of a transition from the start state, thus your initial transition probability is rather meaningless. To get a meaningful est …
jerad's user avatar
  • 1,259