90 views
Consider a Markov Chain with state space $\{0,1,2,3,4\}$ and transition matrix

$$P=\begin{matrix} & \begin{matrix}0&&1&&2&&3 && 4\end{matrix} \\\\ \begin{matrix}0\\\\1\\\\2\\\\3\\\\4\end{matrix} & \begin{pmatrix} 1 & 0 & 0 & 0 & 0 \\\\ 1 / 3 & 1 / 3 & 1 / 3 & 0 & 0 \\\\ 0 & 1 / 3 & 1 / 3 & 1 / 3 & 0 \\\\ 0 & 0 & 1 / 3 & 1 / 3 & 1 / 3 \\\\ 0 & 0 & 0 & 0 & 1\end{pmatrix}\\\\ \end{matrix}$$

Then $\lim _{n \rightarrow \infty} p_{23}^{(n)}$ equals

1. $\frac{1}{3}$

2. $\frac{1}{2}$

3. 0

4. 1
| 90 views