All Questions
Tagged with transition-matrix predictive-models
3 questions
0
votes
1
answer
396
views
Irreducible Markov Chain Question
If you have an irreducible Markov chain with transition matrix $P$, and $p(j,j) > 0$ for all $j$, why are all states aperiodic?
- 1
10
votes
0
answers
353
views
Reinforcement *Model* Learning
Classical reinforcement learning (Q- or Sarsa-Learning) can be extended with models of the environment. These models are usually transition tables that contain the probability of arriving at a ...
- 546
2
votes
1
answer
2k
views
Use multi-state modelling (MSM) to predict individual transition probabilities in R?
I am using R package msm to model multi-state transitions in the sample dataset cav:
...
- 43