Question

1. Consider a Markov chain (Xn)n>0on the state space {0, 1, 2, 3} with transition 0 1 00 probability matrix P given by P = 0.2 0 0.80 0.3 0

0.70 1 0 0 0 Draw the graph of this chain.

Fig: 1

Fig: 2

Fig: 3

Fig: 4

Fig: 5

Fig: 6