6
$\begingroup$

I have a set of Observation Symbol Sequences which I have to test against a set of Trained HMM classifiers. I seem to understand the advantages of using Log Probability over regular probabilities.

In the testing phase of a HMM classifier, I don't seem to get the motivation behind multiplying probabilities or adding log probabilities in determining the class of the observed observation test sequence.

Why do we have to multiply or add probabilities? Can't we just determine probability or log probability of a Single Observation Symbol Sequence using Forward algorithm?

Improve this question
$\endgroup$

2 Answers 2

Reset to default
4
$\begingroup$

A Markov Model has probabilities for each individual transition (the transfer function). In the case of a Hidden Markov Model (HMM) there is also a probability function mapping the hidden state(s) to observations.

These probabilities have to be combined to produce the sequence probability. Therefore they are multiplied. (and for Log probabilities, this operator then becomes an addition)

Improve this answer
$\endgroup$
2
  • $\begingroup$ I am determining the probability of entire observation sequence (one symbol sequence at a time). I was wondering If I have to combine the probabilities of multiple sequences. I'm using jahmm library. $\endgroup$
    – garak
    Commented Feb 10, 2012 at 15:17
  • $\begingroup$ Sorry I don't know enough about your specific application (and jahmm is new to me) - I thought you were talking about adding the probabilities within a sequence. $\endgroup$
    – winwaed
    Commented Feb 10, 2012 at 15:19
5
$\begingroup$

Yes, the probability of an observation sequence can be computed using the forward algorithm.

Note however that the forward algorithm is an iterative algorithm where a bunch of summations and multiplications are carried out in each iteration. So the answer to your second question is yes as well.

Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.