Questions tagged [hidden-markov-model]

Hidden Markov Models are used for modelling systems that are assumed to be Markov processes with hidden (i.e. unobserved) states.

Filter by
Sorted by
Tagged with
-1
votes
0answers
21 views

Generalizing PageRank – Probability that a HMM ends its last n steps within given k states

Background The PageRank algorithm, the way I understand it, assumes a Hidden Markov Model is run for some very large, unknown amount of steps. For every state $s_k$, it tries to estimate the ...
0
votes
0answers
25 views

Hidden Markov Model with response and independent variable

I need to fit a HMM for a machine/process that links some input variable to an output variable. When plotting the values, it is clear that there is a time series pattern. This repeating pattern is ...
1
vote
0answers
14 views

What is HMM and Viterbi algorithm?

I have to learn what is HMM and Viterbi alogrithm, I search all pages on Google, but I can't understand what is HMM is and what is Viterbi is, if there is very basic and very simple examples/...
1
vote
0answers
19 views

HMM Bayesian vs. non-Bayesian

I aim to use Hidden Markov Model for regime detection in time series. My question might be a little too blurry: in which cases it is crucial to use Bayesian version of HMM and in which cases it is ...
0
votes
0answers
17 views

Extending HMM with Gaussian Emissions to GMM

In the notation/language of HMMs, say $h_{1:T_i}^i$ be the hidden states, and $v_{1:T_i}^i$ be the observations where $i=1,\ldots,n$ denote each training set. Let each mutlivariate observation $v_t \...
0
votes
0answers
30 views

Hidden Markov Models - How do you judge the probability that a given sequence of observations is produced by a specific model?

I've been trying to learn about Hidden Markov Models, but am stuck with a certain problem. I have calculated the probability that an observed sequence is produced by a given model as: P(O|λ) = Σ αT(i)...
0
votes
0answers
32 views

explanation of Hidden markov model and its values [duplicate]

So i'm trying to learn about the Hidden Markov Model (HMM) and are solving some problems. Im run into a question that I dont quite understand and are hopeing that someone on here can help me ...
0
votes
1answer
48 views

Seeing a tree graphical model as a Markov model

I have been doing an exercise task and I encountered an issue. Let's imagine that we have a graphical model(binary tree) as in the image below. To every vertex a rv $X_v$ is assigned which obtains ...
0
votes
0answers
19 views

Taking temporal coherence into account: HMM

I would like to detect sleep stages in 30s intervals, given 4 EEG and 1 EMG signals. Since my EEG and EMG data are just timeseries over 24h, they are temporarily coherent. I am currently using Python /...
0
votes
0answers
10 views

Hidden markov random field

I'm working on HMRF in wireless traffic characterization. Please can someone help? If I have 10x10 matrix how can I apply HMRF on this matrix regarding classification of wireless traffic?
0
votes
0answers
48 views

Difference between GMM and HMM

From what I understand: GMM is a probabilistic model which can model N sub population normally distributed. Each component in GMM is a Gaussian distribution. HMM is a statistical Markov model with ...
0
votes
0answers
41 views

Hidden Markov Model Training

I am reading more about sequence prediction tasks NLP specifically and am trying to fully understand HMMs and Viterbi. It seems that the latent structure for HMMs is just two matrices one for state ...
0
votes
0answers
18 views

Markov network, estimating unknown variable with multiple observations

I have this hidden markov model/network with four unknown variables $y_{1:4}$ with the discrete domain $(0,1)$ and four known observations $y^{obs}_{1:4}$ and a potential function $\phi(x_i,x_j)$. $$ ...
1
vote
1answer
58 views

Hidden markov model estimate p(x | y1, y2, y3, …)

I have this hidden markov model/network with four unknown variables $y_{1:4}$ with the discrete domain $(0,1)$ and four known observations $y^{obs}_{1:4}$ and a potential function $\phi(x_i,x_j)$. $$ ...
0
votes
0answers
16 views

Does this problem satisfy markov properties to be modeled as HMM?

I want to model a chemical reaction network which is defined by a stoichiometric matrix $\nu^{s\times m} $ where $s$ is the number of participating species and $m$ the number of chemical reactions. If ...
0
votes
0answers
7 views

hidden markov model fit with an absorbing state

Do the HMM Baum-Welch and Viterbi algorithms assume the underlying states are recurrent? I'm trying to fit an HMM where one of the states is an absorbing state, and I'm not sure if I need to change ...
0
votes
0answers
8 views

Bigram model with checkpoint sequence

I have co-occurence statistics for pairs of words and want to fill-in a sentence given a start word and another word placed in the sentence. Note that my training set never contains anymore than two ...
0
votes
0answers
42 views

Constrained parameters update during hidden Markov model forward-backward algorithm

I want to train a Gaussian hidden Markov model. I currently use the Python package hmmlearn. I looked thouroghly at the code to see how parameters are updated after each training iteration, but I ...
0
votes
0answers
20 views

Markov Chain Attribution Model: Calendar periods VS Sliding Window?

I'm trying to utilize Markov Chains in order to analyze and attribute online conversions of b2b users browsing on a company web. The key question mark I'm facing is on which period length to apply the ...
0
votes
0answers
31 views

How to represent an HMM whose observations are a continuous vector?

I have usually read about HMMs with observation spaces that we can somehow encode as a finite number of observations. How could I use HMM fitting if my observation at each time step is an $n$-...
0
votes
0answers
17 views

Face Recognition using HMM

I had learnt some of the research papers of Face Recognition using Hidden Markov Model. Can you help me how Hidden Markov model is applied to face recognition?Also can you please give some numerical ...
0
votes
0answers
17 views

HMM - Deal with Baum-Welch emission never observed

If I train a HMM with a given sequence of observations among n possible emissions, how do I deal with an emission that is never observed? For example, if in a 100 long observation sequence the ...
1
vote
0answers
17 views

How to work out the global maximum of the likelihood of a hidden Markov model?

I have generated some data based on a transition matrix and emission parameters that I have set. I want to test whether the optimisation algorithm I am using will find the global maximum of the log-...
0
votes
0answers
26 views

What is an appropriate threshold for the EM algorithm?

I am implementing the Baum-Welch algorithm (special case of the EM algorithm) on a hidden Markov model and I now have to pick an appropriate stopping criteria $\epsilon$ so that the algorithm ...
0
votes
2answers
56 views

Convergence of EM algorithm

I am aware that EM eventually converges. However, I still have some confusions regarding this property: 1: As far as I am aware, HMM, Gaussian mixture model and MCMC can converge and all of them use ...
2
votes
1answer
55 views

Hidden-Markov Model for Markov-Chain with Sequential Bernoulli State Sampling

Consider a finite discrete-time Markov chain whose state is sampled at the times determined by the outcome of a Bernoulli process. That is, in each time period I flip a biased coin. If it comes up as "...
0
votes
0answers
15 views

HMM with hidden state of unequal interval

I am constructing a HMM model. However, the hidden states are of unequal interval. Take the rainy / sunny scenario as example. The hidden states I am about to infer is the 1st day, 2nd day, 5th day, ...
1
vote
0answers
54 views

Why do the non-informative a priori distributions give better results than the frequentist estimate?

For example, in the specific case of Markov-Switching GARCH models why is a non-informative prior distribution chosen for GARCH models with Bayesian estimation and why is this approach better than the ...
1
vote
1answer
44 views

Suggest a model for segmenting a time series

Hi all, I have a time series that looks like above. I'm interested in segmenting it into the numbering listed. I've tried using a hidden Markov model, but the versions I can find with multiple ...
0
votes
1answer
17 views

What kind of a priori distribution for the Markov Switching models?

Why in the Markov-Switching models is chosen as prior distribution for the probability of the transaction as follows: $$f(P) \propto \prod_{i=1}^K \left(\prod_{j=1}^K p_{i,j}\right) I \left\{0 < ...
0
votes
2answers
116 views

Suggest a model for this dataset

I have a time series data set (the Old Faithful geyser data available here: http://www.gatsby.ucl.ac.uk/teaching/courses/ml1-2012/geyser.txt). Plotting the eruption duration on the x axis and the ...
0
votes
0answers
15 views

Observations correction using HMM

I don't know if this is even a good idea, but I am trying to implement a HMM such that my hidden states are the same as my output states. So given a sequence of discrete, time-series observations: $$O ...
0
votes
1answer
40 views

What are the differences between Bayesian filters and adaptive filters?

I am learning about state estimation and I am having difficulty understanding the difference between Bayesian filters such as Kalman filter and particle filters compared to adaptive filters. According ...
0
votes
1answer
31 views

Notation for conditional probability when the conditioned event is observed

I am trying to understand proper notation for functions related to state transition models (e.g., a HMM). There are two indexing variables $t$ (time step) and $i$ (state). Such that it matters, in my ...
0
votes
0answers
28 views

How to use Hidden Markov Model for predicting the last state in set of sequences? [duplicate]

I have a dataset consisting of a set of sequences as follows: ...
0
votes
1answer
36 views

HMM rolling estimation different from batch estimation

I'm using the GuassianHMM from the python package hmmlearn and after fitting the hmm to the data the predictions that are done in one batch ...
0
votes
0answers
42 views

What is the point of doing simulation on Markov Chain?

I am studying Markov Chain and I am currently reading about simulation on Markov Chain but I can't see the point of simulation on Markov Chain. What does simulation mean in Markov Chain and what can ...
1
vote
1answer
28 views

can the prior probability change with time?

I was reading Markov Models for sequence modeling and stuck with my understanding(hypothesis). In Baye's theorem, can the prior probabilities change with time? If the prior probability at t=3 is 0.05,...
0
votes
0answers
45 views

HMM training of multiple observations corresponding to different hidden states

Given a set of states $\{q_1,q_2,..,q_n\}$, I am considering the following problem. Corresponding to a sequence of hidden states, I have some observations. first sequence of hidden states ; first ...
1
vote
1answer
20 views

What are the necessary qualifications or assumptions to say that a graph structure is a Markov Chain?

I have a graph structure and want to say it is a Markov Chain. But I am wondering what necessary assumptions or properties that my graph structure need to meet to be called a Markov Chain?
0
votes
0answers
7 views

What are the relationships among Markov Property, Stationarity, and Time Invariance

I am wondering if there is or are any relationship among those. I have understood Markov Property by reading Wikipedia, but it is still confusing to figure out if there is any relationship among those ...
0
votes
0answers
22 views

Model to Bootstrap/ simulate hourly shape from daily data

How do I simulate/boot strap hourly shape from daily data ? $\mathbf {Data set:}$ My first data has hourly granularity, its hourly temperature, $T_1$ through $T_{24}$ and but I have no means to ...
1
vote
1answer
57 views

The difference between forward algorithm used in CRF and the variable elimination?

I found that in the forward algorithm used in the CRF(and perhaps also in the HMM) the mechanism applied is almost the same as that in the variable elimination(VE) except that the emission ...
0
votes
0answers
15 views

To say my model is a stochastic model,what assumptions do I need to make?

I am trying to understand what a stochastic model is and assumptions to be able to say my model is a stochastic model. I am new to it, so I may confuse you. I have gone through Markov chain, Markov ...
1
vote
1answer
320 views

Example of manual implementation of baum-welch algorithm in R

Is there any code out there that implements the baum-welch algorithm for a very basic problem? It would be very helpful to actually see the algorithm in action to better understand how it works. I ...
0
votes
1answer
114 views

Viterbi algorithm for finding most probable path with varying transition probabilities

I'm struggling to apply the Viterbi algorithm to a simple case of inferring hidden states where the transmission probabilities change. I've draw a picture below of the trellis with transition ...
0
votes
1answer
35 views

Generating probability distribution parameters using a neural network

I am new to neural network therefore, my question might be super basic. I am reading this article: https://arxiv.org/pdf/1609.09869.pdf In this article they've made a deep Markov Model in which they ...
0
votes
0answers
15 views

Models for interdependent finite sequences?

I have a large set S of pairs of (short) sequences (, )_i where the first sequence of each pair comes from sequence set A and the second sequence of each pair comes from the sequence set B. Sequences ...
0
votes
0answers
47 views

Applicability of Markov Models for predicting user input

I am trying to predict user action based on the shown content of different modules. Lets assume the user sees a page where several content may be shown or not. The next action of the user depends on ...
0
votes
1answer
38 views

Are conditional mean in an AR(1)-GARCH(1,1) equal for different GARCH(1,1) processes of the same data?

I have created a Markov-Switching GARCH model, where the volatility is defined to be switching between two different GARCH(1,1) processes. The data is assumed to have zero mean, where the data is ...

1 2 3 4 5 11