A regular Markov chain has a stationary distribution and it is unique.

See Markov chain, Fundamental Theorem of Regular Markov Chains

Proof

a)

Let W=(www), where w is a row vector probability distribution.
By definition of Markov Chain, limnPn=(limnPn1)P
So W=WP
Then (www)=(www)P

b)

Suppose v is a stationary distribution of P.
Then v=vP=vP2==vW;
v=vW=(v1v2vn)(www)=(v1+v2++vn)w

Since v is a probability distribution, v1+v2++vn=1
So v=w.

QED

Powered by Forestry.md