Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.
This is a problem in the book of "introduction to stochastic process ". Any help to solve this problem ??
If $P$ is the one-step transition matrix and $P_k$ is the k-step transition matrix then
P_k = P^k.
You are looking to do the calculation for $k = 3$.
Required, but never shown