Search Results
Search type | Search syntax |
---|---|
Tags | [tag] |
Exact | "words here" |
Author |
user:1234 user:me (yours) |
Score |
score:3 (3+) score:0 (none) |
Answers |
answers:3 (3+) answers:0 (none) isaccepted:yes hasaccepted:no inquestion:1234 |
Views | views:250 |
Code | code:"if (foo != bar)" |
Sections |
title:apples body:"apples oranges" |
URL | url:"*.example.com" |
Saves | in:saves |
Status |
closed:yes duplicate:no migrated:no wiki:no |
Types |
is:question is:answer |
Exclude |
-[tag] -apples |
For more details on advanced search visit our help page |
A transition matrix is a square matrix used to describe the transitions of a Markov chain.
1
vote
Finding One Step Transition Matrix in Gambling?
We can generalise your problem by allowing any $y \in \mathbb{N}$ and assuming discrete states $x = 0,1,2...,y$. Assuming that gamble outcomes are independent with fixed win-probability $0 < \theta < …
0
votes
Markov chain: inferring transition rates from equilibrium
If you have a Markov chain with transition probability matrix $\mathbf{P}$ then any stationary distribution $\pi$ for that chain is a unit eigenvector of $\mathbf{P}$ with corresponding eigenvalue of …
4
votes
How could I estimate a transition probability matrix that varies over time?
If the transition probability matrix varies over time then your stochastic process is not a Markov chain (i.e., it does not obey the Markov property). In order to estimate transition probabilities at …
2
votes
How to understand the definition of Markov Chain $P(X_{n+1}\in B\mid \mathcal{F}_n)=p(X_n,B)$?
As pointed out in the comments, Durrett's definition is a general definition of the Markov property in an underlying discrete-time stochastic process, whereas the definition you have given is a type o …