1
$\begingroup$

In the Wikipedia page, you have the following definition for period:

$k = \gcd\{ n > 0: \Pr(X_n = i \mid X_0 = i) > 0\}$

And, for a Markov Chain to be aperiodic, $k = 1$.

It is stated that this happens only and if and only if there exists $n$ such that for all $n' ≥ n$:

$\Pr(X_{n'} = i \mid X_0 = i) > 0$

Is there proof of this last statement anywhere? I can't find it and I don't feel this is intuitive or obvious nor I can prove it.

For example, if $n > 0: \Pr(X_n = i \mid X_0 = i) > 0$ was true for two primes, like 3 and 5, k would already be 1, would this be considered aperiodic too?

$\endgroup$

1 Answer 1

1
$\begingroup$

For those that come looking for this, I found the answer. Both definitions are equivalent, as once you have two co-primes, you will be able to find all natural numbers after a certain N.

This is the coin problem and the solution is the Frobenius number:

https://en.wikipedia.org/wiki/Coin_problem

Here is also a proof I found:

https://www.youtube.com/watch?v=MSdfDWiRDBI

$\endgroup$
0

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.