This is a problem in the book of "introduction to stochastic process ". Any help to solve this problem ??
1 Answer
$\begingroup$
$\endgroup$
2
If $P$ is the one-step transition matrix and $P_k$ is the k-step transition matrix then
$ P_k = P^k. $
You are looking to do the calculation for $k = 3$.
-
$\begingroup$ so I have to calculate P^3 and see state(0,1) or state (1,1) ? $\endgroup$– leikiCommented Aug 8, 2018 at 12:37
-
$\begingroup$ yes I know, it is not a homework, I'm learning by myself and it is out of my domain so sorry for this question because I will do my best to learn all this soon as possible. thank you stants. $\endgroup$– leikiCommented Aug 8, 2018 at 12:57