chapter 17 of the book "Machine Learning - A Probabilistic Perspective" gives this figure

enter image description here

which is the probability of getting from i to j in exactly n steps. Obviously A(1) = A.

In the case of Figure 17.1 (b), the probability of getting from node 1 to node 3 in exactly 2 steps is

$A_{13}(2) = A_{12}(1)A_{23}(1)$

Is that correct?

  • 1
    $\begingroup$ Although it's correct, it's not very illuminating. The nature of the situation starts becoming apparent when you increase the number of steps. $\endgroup$ – whuber Jul 25 at 10:57
  • 2
    $\begingroup$ You can get $n$-step transitions from discrete markov chain by exponentiating the transition matrix $\endgroup$ – logistic Jul 25 at 13:49
  • $\begingroup$ @logistic do you mean this. $A(n)=A^n$ ? $\endgroup$ – czlsws Jul 26 at 0:04
  • $\begingroup$ Yes @czlsws that's what I mean $\endgroup$ – logistic Jul 26 at 12:42
  • $\begingroup$ @logistic thanks for your comments. And how to apply that on "Figure 17.1 (b) node 1 to node 3" $\endgroup$ – czlsws Jul 26 at 22:14

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.