New answers tagged markov-process
5
votes
Accepted
How to understand the definition of Markov Chain $P(X_{n+1}\in B\mid \mathcal{F}_n)=p(X_n,B)$?
IMO, Durrett could have provided a better mechanism for the generalization, albeit being correct.
$\rm [I]$ does provide a more extensive treatment:
Let $(\Omega, \boldsymbol{\mathfrak A}, \Pr) $ be a ...
2
votes
How to understand the definition of Markov Chain $P(X_{n+1}\in B\mid \mathcal{F}_n)=p(X_n,B)$?
As pointed out in the comments, Durrett's definition is a general definition of the Markov property in an underlying discrete-time stochastic process, whereas the definition you have given is a type ...
Top 50 recent answers are included
Related Tags
markov-process × 1367probability × 208
stochastic-processes × 207
markov-chain-montecarlo × 131
hidden-markov-model × 117
time-series × 94
self-study × 94
transition-matrix × 88
monte-carlo × 86
machine-learning × 82
bayesian × 79
reinforcement-learning × 74
r × 65
metropolis-hastings × 61
conditional-probability × 55
sampling × 35
mathematical-statistics × 33
distributions × 32
convergence × 29
stationarity × 28
estimation × 27
references × 26
simulation × 26
predictive-models × 25
maximum-likelihood × 21