I am going to use fancy mermaid to visualize some transition probability matrix.
Exercise 1.14
Do the following Markov chains converge to equilibrium? [1]
(a)
(b)
(c)
(d)
Essentials of Stochastic Processes (3rd Edition) by Rick Durrett (Springer, 2016) ↩︎
