Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 173082

A transition matrix is a square matrix used to describe the transitions of a Markov chain.

1 vote

Finding One Step Transition Matrix in Gambling?

We can generalise your problem by allowing any $y \in \mathbb{N}$ and assuming discrete states $x = 0,1,2...,y$. Assuming that gamble outcomes are independent with fixed win-probability $0 < \theta < …
Ben's user avatar
  • 133k
0 votes

Markov chain: inferring transition rates from equilibrium

If you have a Markov chain with transition probability matrix $\mathbf{P}$ then any stationary distribution $\pi$ for that chain is a unit eigenvector of $\mathbf{P}$ with corresponding eigenvalue of …
Ben's user avatar
  • 133k
4 votes

How could I estimate a transition probability matrix that varies over time?

If the transition probability matrix varies over time then your stochastic process is not a Markov chain (i.e., it does not obey the Markov property). In order to estimate transition probabilities at …
Ben's user avatar
  • 133k
2 votes

How to understand the definition of Markov Chain $P(X_{n+1}\in B\mid \mathcal{F}_n)=p(X_n,B)$?

As pointed out in the comments, Durrett's definition is a general definition of the Markov property in an underlying discrete-time stochastic process, whereas the definition you have given is a type o …
Ben's user avatar
  • 133k