Search for question
Question
(5) Consider the Markov chain with infinite state space {1, 2, 3, ...} and transi-tion matrix given by p(i, i + 2) = q and p(i, max{1, i – 1})
= 1- q for i>=1. For which values of q E [0, 1] is this chain transient, positive recurrent, and null recurrent?
Fig: 1
Fig: 2
Fig: 3
