Questions tagged [baum-welch]

The Baum–Welch algorithm is used to find the unknown parameters of a hidden Markov model (HMM).

Filter by
Sorted by
Tagged with
0 votes
0 answers
33 views

Q function in Baum-Welch algorithm

Assume there's a hidden Markov Model $\lambda=(\pi, \mathbf{A}, \mathbf{B})$, where $\pi$ is an initial distribution, $\mathbf{A}$ is a transition matrix and $\mathbf{B}$ is an emission matrix. Also, ...
thesecond's user avatar
  • 350
0 votes
0 answers
27 views

Baum Welch algorithm for Semi-Continuous (Tied-Mixture) Hidden Markov Model

I'm currently implementing Baum-Welch algorithm for Semi-Continuous Hidden Markov Model (SCHMM) as described in Huang, Xuedong. Semi-continuous hidden Markov models for speech recognition, 1989, pages ...
thesecond's user avatar
  • 350
1 vote
0 answers
199 views

help me understand a part of the baum welch algorithm for hidden markov models

I am having troubles understanding a crucial part of the baum-welch algorithm in hidden markov models. When we calculate zhe/digamma representing the probability of being in state i at timestep t and ...
fearloathing121's user avatar
1 vote
1 answer
591 views

How do I check my own Baum Welch Algorithm

Given an observation {1,1,1,1,1,1,1,1,0} Transition matrix$\,$A \begin{bmatrix} 0.5 & 0.5 \\ 0.3 & 0.7 \end{bmatrix} Emission matrix$\,$B \begin{bmatrix} 0.3 & 0.7 \\ 0.8 &...
Linear Algebra fans's user avatar
2 votes
1 answer
181 views

Optimizing HMM log-likelihood with time-dependent prior

I have a HMM (Hidden Markov Model) which emits an observation Z. The parameters of the HMM are $\boldsymbol\theta$. $$\boldsymbol\theta = {\boldsymbol{A},\boldsymbol{B},\pi}$$ Where $\boldsymbol{A}$ ...
robotlover's user avatar
3 votes
0 answers
669 views

Initialisation strategies for learning Hidden Markov Models

I used hmmlearn library to initialize an HMM (Hidden Markov Model). sampled observations from the HMM, and used the sampled data to re-estimate the parameters of ...
abhishek's user avatar
  • 236
1 vote
1 answer
75 views

Bayes Theorem for Baum-Welch algorithm

I've been reading the Baum-Welch algorithm and somewhere it mentioned this statistical property: $$ P(X \mid Y,Z) =\frac{ P(X,Y \mid Z)}{P(Y \mid Z)} $$ being based on Bayes' Theorem. I do understand ...
Ramil's user avatar
  • 11
3 votes
1 answer
429 views

Expectation Maximisation vs Expectation Propagation in the context of Bayesian Networks

I am confused about Expectation Maximisation and Expectation Propagation algorithms in the context of Bayesian Networks, especially whether one comprise another. What is the difference between ...
Pumpkin's user avatar
  • 131
1 vote
1 answer
2k views

Example of manual implementation of baum-welch algorithm in R

Is there any code out there that implements the baum-welch algorithm for a very basic problem? It would be very helpful to actually see the algorithm in action to better understand how it works. I ...
Phd Student's user avatar
1 vote
0 answers
81 views

Minimum Population Size for T-Test

I'm comparing two different populations with unequal variance and non normal distributions. For sample #1 I'm drawing a random sample size of $n=30$ from a population of 200. For sample #2 I'm ...
Khalid Rahman's user avatar
0 votes
1 answer
192 views

Deciding length of units in sound recognition for training HMMs

I am working on creating a method to detect changes from one song to another. Namely, I hope to use a Hidden Markov Model (HMM) in order to model a part of a song and check to see if it accurately ...
somil's user avatar
  • 103
5 votes
1 answer
1k views

Viterbi and forward-backward algorithm in HMM

I am learning HMM recently and got confused with the training problem (training model parameters and hidden state given outcome sequence). As far as I know, both Viterbi learning and Baum-Welch (...
unicorn's user avatar
  • 859
1 vote
0 answers
5k views

How do I report a Welch's test?

I ran a Welch's test with Alpha= 0.05 followed by a Games Howell test. The Welch's test is not significant (p-value=0.104) Is it enough to just mention that the groups were not significantly different ...
Hadi's user avatar
  • 43
5 votes
1 answer
3k views

What are some applications of unsupervised HMMs?

Supervised HMMs can be applied to many problems like POS tagging and OCR (optical character recognition). I've learned that HMMs can be trained unsupervisedly using EM (Baum-Welch algorithm), what ...
dontloo's user avatar
  • 16k
2 votes
1 answer
142 views

MFCCs and MoG-HMMs for speech recognition

BACKGROUND MFCCs are coefficients which represent the most important parts of speech, and about 12 of them are used to model a one 512 points long frame (of speech). Along with them you would use ...
Desperado's user avatar
  • 131
5 votes
2 answers
6k views

Simple Explanation of Baum Welch/Viterbi

I'm looking for a very simple explanation as possible for Baum Welch and Viterbi for HMMs with a straightforward well annotated example. Almost all of the explanations I find on the net invariably ...
A D's user avatar
  • 113
1 vote
0 answers
349 views

What if transitions and emissions in a hidden Markov model are not independent?

A Hidden Markov Model is given by transition and emission matrices. The transition matrix determine probability of "next states" as a function of the current state. The emission matrix determine the ...
Roman's user avatar
  • 554
4 votes
1 answer
1k views

Baum-Welch and hidden Markov models: Continuous observation densities in HMMs

I am currently trying to understand how parameter are being reestimated for hidden Markov models (HMMs), using expectation-maximization (EM). What I seem to have problems understanding is what the ...
Bob Burt's user avatar
  • 635
1 vote
1 answer
138 views

Produce Multiple Sequence Alignments using Profile HMMs

I have a few multiple sequence alignments and a few groups (let's say N) of unaligned sequences. I would like to learn the emission and transition probabilities from the multiple sequence alignments, ...
Eszter's user avatar
  • 111
4 votes
1 answer
2k views

Baum Welch training of HMM

I have 200k sequences and each element of the sequence is vector of length 200. I plan to learn a HMM using this data, using the Baum-Welch EM algorithm to infer transition and emission probabilities. ...
Subraveti Suraj's user avatar
3 votes
1 answer
2k views

Forward-backward algorithm for HMM

I am currently studying this paper In which i am having some problems understanding the purpose of the forward-backwards algorithm. First of all why even have both forward and backwards? It seems ...
Bob Burt's user avatar
  • 635
4 votes
1 answer
968 views

re-estimation of emission probabilities in HMM

I am confused about the re-erstimation procedure for emissions in HMMs with Baum-Welch (still). I posted two questions concerning this general topic already and I thought I had cleared up my confusion,...
lo tolmencre's user avatar
0 votes
1 answer
629 views

Do re-estimated HMM parameters still need to be normalized?

A few days ago I asked this question. I only got one answer and I did not really understand it. Now I think this question is a special case of a more general question I have, namely: Do re-estiamted ...
lo tolmencre's user avatar
5 votes
2 answers
4k views

Scaling step in Baum-Welch algorithm

I am implementing the Baum-Welch Algorithm for training a Hidden Markov Process, to basically better understand the training process. I have implemented the iterative procedures described in Rabiner'...
Vahagn Tumanyan's user avatar
0 votes
1 answer
883 views

Can the distribution of emission probabilities of an HMM be swapped out for the re-estimated ones only after all training sequences have been covered?

Regarding the re-estimation procedure of the Baum-Welch algorithm, the sources I looked into so far all describe the process in an abstract manner. Therefore I am wondering the following about ...
lo tolmencre's user avatar
0 votes
1 answer
506 views

combining log likelihoods from different series of observations

I have generated multiple log likelihood estimates for some parameters $\theta$ based on independent sets of observation. How can I combine these into one average?
R-4's user avatar
  • 41
1 vote
0 answers
229 views

Hidden Markov Model EM Training: Linking states to hidden variables

I want to implement the Baum Welch Algorithm for unsupervised training of Hidden Markov Models, I am however still a little unclear on some details, especially this one: Before learning the optimal ...
lo tolmencre's user avatar
0 votes
1 answer
317 views

EM algorithm update step formula

I'm using these formulas to update my initial vector, transition matrix and emission matrix: I have update my initial vector fine using formula (1) but the other two formula have an alpha instead of ...
R-4's user avatar
  • 41
1 vote
1 answer
626 views

Calculating alpha in EM / Baum-Welch algorithm for Hidden Markov

I am trying to use this equation to calculate the alpha (forward) probabilities for the EM/Baum-welch algorithm but I'm running into some confusion. I don't understand what the $h_t$ is. I know its a ...
R-4's user avatar
  • 41
1 vote
0 answers
199 views

Which parameters need to be initialized random for gaussian mixture hidden markov model?

So, if I model observation probability for a given hidden state according to a multivariate gaussian mixture model, then which parameters need to be initialized random to perform parameter re-...
Kevvy Kim's user avatar
  • 349
2 votes
1 answer
1k views

baum-welch parameter estimation numeric example

I have an HMM (picture below), with a single parameter $\theta$ I want to estimate using Baum-Welch. I have a single training example X="HHT", and I start with an ...
ihadanny's user avatar
  • 3,230
2 votes
0 answers
1k views

HMM (Baum-Welch) - convergence rate differences between the transition and output matrices

I am trying to learn more about the convergence properties of the Baum-Welch algorithm for estimating the HMM parameters. I ran a test comparing the convergence of both the transition and output ...
Goek's user avatar
  • 101
1 vote
1 answer
314 views

HMM with some known inputs

I am trying to solve a problem using HMM where the observations Yt are the result of both known and hidden parameters, but unfortunately, I am not sure how to combine the known and hidden parameters ...
Jason K.'s user avatar
  • 175
2 votes
1 answer
3k views

How to Train HMM model with two different sequences using the Baum-Wech algorithm

I am using HMM to visualize drinking gestures of different container types. I began training HMM with one sequence corresponding to one container type, but I want to visualize it with python now with ...
Emna Jaoua's user avatar
2 votes
0 answers
603 views

Baum-Welch algorithm variation for Hidden Markov model with reward

Following my previous question on the subject I would like to get your feedback on the following alternative solution. (The original solution to this question is the usage of the POMDP model proposed ...
Goek's user avatar
  • 101
0 votes
1 answer
402 views

Baum Welch:Calculating transition probability

I am trying to understand the Baum Welch algorithm by implementing it in xls. I have chosen a simple example of observations from a loaded (L) vs fair (F) die. I calculate the forward and backward ...
Ritu apnde's user avatar
0 votes
1 answer
688 views

In what way does clustering help in classification?

I understand that with a K-means or DTW algorithm one can cluster time series using a distance criterion, i also understand that with a K-NN algorithm for example one can do pattern recognition and ...
Abbas's user avatar
  • 3
1 vote
0 answers
291 views

How do I find the hidden states of a HMM for a non time series data? How does EM Algorithm play a role in HMM?

I am a beginner in machine learning. My project requires me to model user intentions using HMM i.e based on parameters like no.of clicks, time on page, etc I have to model whether the user wants to ...
Harshita Pathak's user avatar
5 votes
2 answers
2k views

How to model Hidden markov model with changing transition probability

I have a series of observations that fall into two outcomes, 0 or 1. These observations have an associated time of observation, as well as additional features that I can gather for that observation. I ...
Andrew's user avatar
  • 219
22 votes
2 answers
28k views

What are the differences between the Baum-Welch algorithm and Viterbi training?

I am currently using Viterbi training for an image segmentation problem. I wanted to know what the advantages/disadvantages are of using the Baum-Welch algorithm instead of Viterbi training.
Mykie's user avatar
  • 511