Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [viterbi-algorithm]

The tag has no usage guidance.

0
votes
0answers
4 views

Is negative Viterbi Loss possible?

So I'm training a sequence-labeling model with a BiLSTM-CRF architecture, and I am getting negative values on Viterbi Loss. Is this possible? I'm using the following formula in my code, as specified ...
0
votes
0answers
6 views

Biased viterbi training result

I try to use GMM-HMM model to infer the topic of sentences in a short paragraph. While instead of using normal Baum-Welch optimization, I use viterbi training as follows. I use average of word ...
0
votes
0answers
17 views

Normalizing output of Viterbi algorithm

Viterbi algorithm can be used to solve problems in belief networks of the following kind: $$argmax_{x_{1:t}}P(x_{1:t}| e_{1:t})$$ where $e_{1:t} \in E^t$ are evidence variables and $x_{1:t} \in S^t$ ...
1
vote
1answer
136 views

Viterbi and forward-backward algorithm in HMM

I am learning HMM recently and got confused with the training problem (training model parameters and hidden state given outcome sequence). As far as I know, both Viterbi learning and Baum-Welch (...
0
votes
0answers
47 views

Viterbi Algorithm vs Maximum of Variational Posterior for HMM

I have a HMM with observed values $x$ and latent values $z$, upon which I've performed variation inference to get an approximate posterior distribution $q(z|x)$. If I want to calculate a "most likely ...
0
votes
0answers
37 views

What is the relationship between the EM-algorithm, forward-backward alrgorithm and Viterbi algorithms for Hidden Markov Model?

I know procedure of viterbi, EM-algorithm, and forward-backward independently for Hidden Markov Model. But what the relationship between them?
1
vote
0answers
97 views

Classification Using The Hidden Markov Model

I am having difficulty understanding certain concepts regarding the classification using HMM. There are numerous post here and in the internet about that, but they never get to detail or they all ...
1
vote
1answer
46 views

Can all or most combinatoric optimization problems in Machine Learning be solved using Viterbi algorithm? [closed]

I am just scratching the surface of the topic but are there practical limitations even for Viterbi Algorithm? Also, are Viterbi Algorithm and dynamic programming equivalent?
1
vote
0answers
120 views

What if transitions and emissions in a hidden Markov model are not independent?

A Hidden Markov Model is given by transition and emission matrices. The transition matrix determine probability of "next states" as a function of the current state. The emission matrix determine the ...
1
vote
1answer
49 views

Produce Multiple Sequence Alignments using Profile HMMs

I have a few multiple sequence alignments and a few groups (let's say N) of unaligned sequences. I would like to learn the emission and transition probabilities from the multiple sequence alignments, ...
0
votes
1answer
435 views

Decode the most likely sequence of states for the following sequence

A two-state HMM is constructed from the measurements shown below. The mean length indicates the average time that the HMM stays in the state. Decode the most likely sequence of states (P/Y) for ...
1
vote
1answer
2k views

Matlab hmm viterbi algorithm calculated state sequence Probability

I have used matlab hmmviterbi function in my code for calculating the most probable state sequence from observation sequence. Is there any way to derive the probability (score) of this calculated ...
0
votes
1answer
569 views

Other method to find the most likely hidden state in HMM?

If I use Baum-Welch algorithm to best estimate the parameters for hidden Markov model, then I was thinking, instead of using Viterbi algorithm, why can't I just find the most likely hidden state for ...
2
votes
0answers
809 views

HMM for sequence classification in R

I have a dataset which includes sequence of DNA nucleotides (A,C,G,T) and each sequence has a gene index that is binary. i.e I'm trying to classify unknown sequence by using a hidden markov model in ...
7
votes
2answers
6k views

Calculating Emission Probability values for Hidden Markov Model (HMM)

I'm new to HMM and still learning. I'm currently using HMM to tag part-of-speech. To implement the viterbi algorithm I need transition probabilities ($ a_{i,j} \newcommand{\Count}{\text{Count}}$) and ...
2
votes
0answers
28 views

How large a training set do I need for an English POS tagger?

I'm trying to implement a POS tagger for English using the Viterbi algorithm on an HMM model. Right now, my results are poor and I'm not sure whether it's due to a bug or due to lack of training data. ...
0
votes
1answer
394 views

In what way does clustering help in classification?

I understand that with a K-means or DTW algorithm one can cluster time series using a distance criterion, i also understand that with a K-NN algorithm for example one can do pattern recognition and ...
8
votes
1answer
6k views

Explain Backward algorithm for Hidden Markov Model

I have implemented Viterbi and Forward algorithm, alas strangely I can't understand how does Backward algorithm work. Intuitively I feel like I need to do the same thing as in Forward only backwards, ...
0
votes
0answers
206 views

Using Viterbi Algorithm to find the most probable sequence

I have this problem, but I couldn't find any related literature. Let's assume that I have this arrival process (the system can fit just one user): With probability $P_a$ the next user is from class ...
2
votes
0answers
141 views

Predicting Trend using Hidden Markov Model

I am trying to predict exchange rates trend using Hidden Markov model (Viterbi Algorithm). For 2 state trending, I use A = [0.9 0.1; 0.1 0.9] as transition matrix and B = [1/N 1/N ....1/N; 1/N 1/N .....
1
vote
0answers
172 views

What is the difference between coupled HMM's viterbi algorithm and tranditional HMM's viterbi algorithm?

Can anyone show me what is the difference between coupled HMM's viterbi algorithm and tranditional HMM's viterbi algorithm? Is there any examples?
40
votes
5answers
37k views

What is the difference between the forward-backward and Viterbi algorithms?

I want to know what the differences between the forward-backward algorithm and the Viterbi algorithm for inference in hidden Markov models (HMM) are.
17
votes
2answers
19k views

What are the differences between the Baum-Welch algorithm and Viterbi training?

I am currently using Viterbi training for an image segmentation problem. I wanted to know what the advantages/disadvantages are of using the Baum-Welch algorithm instead of Viterbi training.