Questions tagged [hidden-markov-model]

Hidden Markov Models are used for modelling systems that are assumed to be Markov processes with hidden (i.e. unobserved) states.

Filter by
Sorted by
Tagged with
1
vote
1answer
26 views

Getting started with Bayesian Dynamic Networks?

Dagum developed DBNs to unify and extend traditional linear state-space models such as Kalman filters, linear and normal forecasting models such as ARMA and simple dependency models such as hidden ...
0
votes
0answers
23 views

HMM continuous x, discrete y

I'm curious about whether an HMM variant is appropriate when I have a continuous x (time series) and a discrete y (emission class.) In context, I have multiple ships, which could be located in one of ...
0
votes
0answers
12 views

Local independence vs global independence in markov network

I am having a hard time understanding the basic differences between the local independence and global independence of a markov network. Please help me illustrate with a graph or any example
0
votes
0answers
11 views

calculating factors of markov chain [closed]

How do i calculate these numbers(image below) in a markov chain. What is the intuition behind this. I understand, since these are undirected graphs we are trying to calculate the strength of edges as ...
1
vote
0answers
41 views

Using Forward Backward algorithm to find posterior probability of all possible states

I understand that Viterbi finds the most probable sequence of states. However, I want the probability of all possible sequences of states. I understand that FB algorithm can be used to find the ...
0
votes
0answers
45 views

Comparing if obseration sets come from the same HMM

I am using a recurrent network to try and "play" stock data. I want to ask the statistical question "is my model behaving randomly?" I have two Markov chains. Both have 3 states ...
0
votes
0answers
20 views

A problem of likelihood function in a dynamic setting?

I'm having a problem regarding perhaps conditional maximum likelihood problem, but I'm not sure. Suppose time horizon we consider is $T=4$, our goal is to minimize the loss function $$ \sum_{t=2}^T L(...
3
votes
1answer
65 views

Viterbi Algorithm - Most likely sequence vs sequence of most likely states

I'm trying to understand why the following pseudo-code function is correct: ...
0
votes
0answers
20 views

Hidden Markov Model library to study animal movement (preferably in R)

I want to describe the behaviour of whales using data of their vertical movement. Besides the time-depth profile of tagged whales, I calculated several variables for each dive performed (e.g. maximum ...
0
votes
0answers
23 views

Latent Transition Analysis vs Latent Class Growth Analysis

I am curious, what are the main differences between latent transition analysis and latent class growth analysis? I am wanting to model latent classes and probabilities of changes between the classes ...
0
votes
0answers
59 views

Graphical Representation of Dynamic Bayesian Network

Some tourists visiting a cabin are interested in finding out if there are animals nearby. They can observe outside of their window every day whether there are animal tracks and whether the food they ...
0
votes
0answers
11 views

Hidden Markov Model, Particle Filtering: determining an importance density

I am working on implementing particle filtering on the following Hidden Markov Model: $$ X_1 \sim N(0,5) $$ $$ X_n = \dfrac{X_{n-1}}{2} + 25 \dfrac{X_{n-1}}{1+X^2_{n-1}} + 8\cos(1.2n) + V_n, \quad V_n\...
0
votes
0answers
23 views

How do shared weight vectors work for CRF?

I am going through two materials regarding Conditional Random Fields. The first one is this (referred to as [1]) material by Charles Sutton and Andrew McCallum and the second one is this (referred to ...
2
votes
1answer
183 views

Logistic probabilities of state variable in a hidden Markov model always has variance of zero

Here is a simplified version of a more complicated problem that I have. Imagine a hidden Markov model where the state is $X_t\sim N(\mu,\sigma^2)$. The observed variable is $Y_t\sim Bin(N, p_t)$ ...
2
votes
0answers
53 views

Optimizing this log-likelihood

I have a HMM which emits an observation Z. The parameters of the HMM are $\boldsymbol\theta$. $$\boldsymbol\theta = {\boldsymbol{A},\boldsymbol{B},\pi}$$ Where $\boldsymbol{A}$ is the transition ...
0
votes
0answers
29 views

Generating Error Data

I am currently doing a project on finding the HMM parameters for a channel which takes a DNA sequence as an input and aims to output the same sequence. However, the channel has insertion, deletion, ...
1
vote
0answers
26 views

Correlation between two consecutive observed states in a simple Hidden Markov Model with Gaussian emission

Backgrounds Suppose a Hidden Markov process with Gaussian emission and two possible latent states: $s \in \{0,1\}$. I have a observed sequence $\mathcal{X} = \{X_1, X_2, \cdots, X_T \}$, where $X_i$: $...
0
votes
0answers
18 views

Use HMM for time series classification in python - define initial states

I have a time series of locations. I want to use HMM for classification of path, by using the knowledge I have on the locations. I know that locations [0,100] should be state A , [100,200] are state B ...
2
votes
1answer
44 views

Hidden Markov Models and How to Interpret Probability of the Overall Sequence?

What can I do to improve the probability of a sequence given my data? Consider the following MWE: ...
0
votes
1answer
24 views

Interpreting viterbi decoding and posterior probabilities

I am wondering why the last state of the predicted probabilities does not match the viterbi decoding sequence. Consider this MWE: ...
0
votes
1answer
38 views

How do I find Schwartz criterion (or Bayesian Information Criterion) for these three models?

I have to find the schwarz criterion for each of the models in this maths question using RStudio but I don't know where to start. I know I need to find the free parameters but don't know how to find ...
0
votes
0answers
27 views

JAGS the precision parameter accidentally falls on 0

I am using JAGS to create an HMM model and I get stuck with a weird problem. Most of the time, the code works, but sometimes it fails and the failure is about invalid parent values of node: ...
0
votes
0answers
15 views

Hidden Markov Model - Dealing with observation lags

I have a Hidden Markov Model with a "publication lag" (i.e. the observation "published" in period $t$ is actually measured in period $t-1$). For example, a survey asking about ...
0
votes
0answers
13 views

Optimal sampling rate for forward algorithm

I have a system with a binary-state. The system state is estimated by an HMM forward-algorithm. Also, the system allows a varying sampling rate. Considering that the system state transition takes a ...
0
votes
1answer
29 views

Hidden Markov Model: How to define the state observation matrix B for continuous (Normal) observations?

I am having a hard time understanding how to use the observation matrix B for continuous HMM assuming the observation of each hidden state Normal. So far I defined the matrix B as an Nx2 matrix where ...
0
votes
1answer
16 views

Is an HMM an appropriate model for a case like this? If not, what is?

I hope to build a fully empirical model of Total Daily Energy Expenditure (TDEE), i.e. the number of calories an individual must eat in order to neither lose nor gain weight. As data, I have ...
0
votes
0answers
16 views

Help with state-space Markov-switching models

I am new to state-space models with Markov-switching, but the reason I am interested in this is because I want to model trend productivity in the fashion of Kahn & Rich (2007). In general, I am ...
0
votes
1answer
42 views

Is statistical machine translation similar in many ways to Hidden Markov Model? How can we justify it?

Came across this question but didn't know the correct answer, if anyone could clear this out would be of great help. 'If we say we Statistical machine translation is similar in many ways to Hidden ...
1
vote
0answers
22 views

Dirichlet Process vs Hierarchical Dirichlet Process: coupling among transitions on infinite HMM

I'm new to nonparametric Bayesian, and I am reading a paper about beam sampling for the infinite hidden Markov model. In the paper, it is mentioned that since there is no coupling among the ...
1
vote
1answer
46 views

Efficiency of Viterbi Algorithm

Considering that we have a sequence of observed states $\{y_1, y_2, \dots, y_T \}$ of length $T$. We want to generate a path $\{x_1, x_2, \dots, x_T\}$, which is a sequence of states $x_n \in S = \{...
0
votes
0answers
16 views

What model to use when examining subject specific control variables on the outcome?

I want to study whether a trader will buy or sell a stock from a given set of stocks =[1,2,3,...,n], based on the sentiment scores of these stocks [sent_1, sent_2, sent_3, ..., sent_n]. So basically I ...
0
votes
0answers
17 views

Browser history topic clustering

I have a detailed browser history where each event has a visit time, visit duration, URL, and page title. For example let's consider this browser history (page titles only): is Thailand open for ...
4
votes
1answer
211 views

Forward algorithm vs Forward–backward algorithm

Both the forward algorithm and the forward-backward algorithm are expected to provide a probability for the hidden states. For a live estimate of the state, does it pay to add latency to the output ...
0
votes
0answers
22 views

Hidden Markov Model

For part b, would the answer be p = 7/10 since the left hand is biased, we would look at every q that has L and check the observation for every L that has H?
1
vote
1answer
99 views

Number of states in HMM

I am testing a HMM model by generating data from a 3x3 transition matrix and 3x4 emission matrix and then trying to train a HMM model against this data with different initializations. When I plot the ...
0
votes
0answers
9 views

Separating random and correlated errors

When running the ping command over a IP network for a period of time, I assume the packet loss will be a combination of: Random, uncorrelated failures where the ...
2
votes
1answer
30 views

Predicting Graph Edge Connections

I have a set of nodes in 3d physical space. Some of those nodes are connected to one another by a graph edge, while others are not. Just because two nodes are physically close doesn't necessarily mean ...
0
votes
1answer
19 views

Viterbi Algorithm [closed]

Can someone explain why Is it because for the left argument, we would find the most likely sequence of states given observations and for the right argument, we would eventually find the most likely ...
0
votes
0answers
97 views

Tensorflow Hidden Markov model

A decoding HMM has 3 parameters. But I am bit confused in tensorflow's HMM parameters and I'm not clear with docs https://www.tensorflow.org/probability/api_docs/python/tfp/distributions/...
0
votes
0answers
98 views

Update the Emission Matrix in Baum-Welch Algorithm for HMM: Numerical Example

I am trying to manually implement a numerical example of the Baum-Welch Algorithm from the following Tutorial https://handwiki.org/wiki/Baum%E2%80%93Welch_algorithm. I do not understand how the ...
0
votes
0answers
12 views

HMM/Linear Dynamical System - How do I incorporate observation lags?

I'd like to use a Linear Dynamical System to model economic time series (e.g. Total Non-Farm Payroll), as observed in economic releases from the BLS, BEA, etc. There are two stylized facts about the ...
1
vote
1answer
31 views

How do I model state transitions, but conditioned on extra features?

I'm trying to model a dataset in which the goal is to predict the path of users through a series of states. The state space is very simple, with just three states, and I have plenty of sequence ...
0
votes
0answers
38 views

How to interpreting the log-likelihood values of Hidden Markov Model?

I have working with Hidden Markov Models for prediction purposes. I have used 8-HMMs each with 3,4,5 and 6 hidden states for a dataset. So, I have 4 sets: ...
0
votes
0answers
25 views

Best way to get a single sequence of states using Viterbi algorithm in Stan/R

I am writing this up because it seems like there should be a standard, easy way to do this and I just haven't found it. I wrote up my Viterbi algorithm in Stan as shown here in the Stan User's Guide, ...
1
vote
2answers
49 views

Understanding Bishop on EM for HMM's

I'm reading page 616 of Bishop's PRML (pdf), which introduces EM for hidden markov models with categorical hidden states and arbitrary emission distributions. Bishop defines $z_n$ as the hidden state ...
0
votes
0answers
9 views

Difference between Infinite HMM and Latent Variable Model with Sequential Chinese Restaurant Prior?

What is the difference between an infinite HMM (http://mlg.eng.cam.ac.uk/zoubin/papers/ihmm.pdf) and a latent variable model where the latent states are given by a distance-dependent Chinese ...
0
votes
0answers
81 views

Understanding how to calculate removal effects in a markov chain

I am currently trying to model a Marketing Multi-Channel Attribution. All the articles and the packages I have come across use a special "start" state and the removal effect is calculated ...
0
votes
0answers
64 views

imputing high percentage of missing data in multivariate time series

In a dataset with time-series, that is dependant on a given input, which the time-series are given only on an irregular cycle of 10-12 time steps that makes lots of missing observations what is the ...
1
vote
1answer
86 views

Covariate dependent Markov models? Plot state transition probability along gradient of covariate values

fist post here, came from Stack overflow as it was suggested to me this is more appropriate for the kind of question. So, data consists of 4 variable, id, x1 and x2, continuous variables which are ...
0
votes
1answer
112 views

Equivalence between ARIMA and HMM

The question is about the equivalence between ARIMA models and hidden Markov models in the context of time series analysis/prediction. Specifically: Can any ARIMA(p,d,q) model bet represented by an ...

1
2 3 4 5
11