# how to solve this markov chain problem?

This is a problem in the book of "introduction to stochastic process ". Any help to solve this problem ??

• where to add a working hyperlink ? – leiki Aug 8 '18 at 14:16

If $P$ is the one-step transition matrix and $P_k$ is the k-step transition matrix then
$P_k = P^k.$
You are looking to do the calculation for $k = 3$.