Take the 2-minute tour ×
Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. It's 100% free, no registration required.

I found the following definition:

"A probabilitly distribution $\pi = \{\pi_x\}_{x \in S}$ on the state space $S$ is called a stationary distribution for the Markov chain if for every $t > 0$,

$$ \pi^T P_t = \pi^T $$

What does $P_t$ mean? I thought it was the t'th step matrix of the transition matrix P but then this would be for discrete time markov chains and not continuous, right?

Oh wait, is it the transition matrix at time t?

share|improve this question

1 Answer 1

up vote 0 down vote accepted

You can always get a continuous time version of a discrete one by simply "Poissonizing" it. For example, if you have a discrete time Markov chain with transition matrix $T$ you get a continuous time version by considering $$P_t = \sum_{n\geq 0} \frac{t^n}{n!}\exp(-t)T^n $$ Hence the above definition makes sense in the context of continuous time Markov chains.

share|improve this answer
1  
Yeah, but what does $P_t$ mean? Is it the t'th step transition matric or the transition matrix at time t? Or are these two things the same? –  Kaish Nov 22 '12 at 15:10
    
$T^n$ is the $n$-th step transition matrix, i.e. the probability of finding the walker in state $y$ after $n$ steps, given it has started in state $x$ is $(y,T^n x)$. Similarly, the probability of being in state $y$ after time $t$ and starting at $x$ is $(y,P_t x)$. –  Sven Stodtmann Nov 22 '12 at 15:53

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.