This is a problem in the book of "introduction to stochastic process ". Any help to solve this problem ?? enter image description here

  • $\begingroup$ where to add a working hyperlink ? $\endgroup$ – leiki Aug 8 '18 at 14:16

If $P$ is the one-step transition matrix and $P_k$ is the k-step transition matrix then

$ P_k = P^k. $

You are looking to do the calculation for $k = 3$.

  • $\begingroup$ so I have to calculate P^3 and see state(0,1) or state (1,1) ? $\endgroup$ – leiki Aug 8 '18 at 12:37
  • $\begingroup$ yes I know, it is not a homework, I'm learning by myself and it is out of my domain so sorry for this question because I will do my best to learn all this soon as possible. thank you stants. $\endgroup$ – leiki Aug 8 '18 at 12:57

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.