3
$\begingroup$

I have 200k sequences and each element of the sequence is vector of length 200. I plan to learn a HMM using this data, using the Baum-Welch EM algorithm to infer transition and emission probabilities. I wanted to know if I can do the fitting in batches of sequences(i.e. learn a HMM from say 1000 sequences first, and then train this HMM with the next 1000 sequences and so on). Is this right? Why should I/should I not do this? How does this compare with fitting a HMM with all 200k sequences at once?

$\endgroup$
  • $\begingroup$ You might want to consult Rabiner's excellent paper, section V.B: Multiple Observation Sequences. He has a clear explanation of how you have to modify the learning step. Also, have a look at this answer. $\endgroup$ – DimP Apr 27 '17 at 15:17
2
$\begingroup$

I wouldn't recommend the batch method you suggested, since the final trained HMM will mainly reflect the final 1000 sequences. The influence of the remainder of the sequences will be limited, contributing only to the starting parameters of the model prior to the last model-training step. That said, I realize Baum-Welch training for large sequence sets such as this can be rather slow. You may wish to consider learning an initial model with the faster Viterbi training method (a.k.a segmental K-means algorithm; see Juang & Rabiner (1990) IEEE Transactions on Acoustics... 38, 1639-1641), and then refining the parameters further with Baum-Welch. Alternatively you could just use Viterbi training on its own; I have found this method often yields models of comparable quality to those trained with the Baum Welch algorithm.

$\endgroup$
  • $\begingroup$ Thank you! Do you know of any libraries that implement this training method? $\endgroup$ – Subraveti Suraj Apr 29 '17 at 19:12
  • $\begingroup$ The aphid R package should be able to do it. It's designed for analyzing biological sequences but works well for other applications. The package isn't on CRAN yet but is available with download instructions at github.com/shaunpwilkinson/aphid $\endgroup$ – Shaun Wilkinson Apr 30 '17 at 23:41
  • $\begingroup$ Aah, I was looking for something in Python. Pandas/NumPy fan :p $\endgroup$ – Subraveti Suraj May 1 '17 at 0:33

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.