A regular Markov chain has a stationary distribution and it is unique.
See Markov chain, Fundamental Theorem of Regular Markov Chains
Proof
a)
Let
By definition of Markov Chain,
So
Then
b)
Suppose
Then
Since
So
QED
Select a result to preview
See Markov chain, Fundamental Theorem of Regular Markov Chains
a)
Let
By definition of Markov Chain,
So
Then
b)
Suppose
Then
Since
So
QED