Rational Solver
+1 vote
905 views
Consider a Markov Chain with state space $\{0,1,2,3,4\}$ and transition matrix

$$P=\begin{matrix} & \begin{matrix}0&&1&&2&&3 && 4\end{matrix} \\\\ \begin{matrix}0\\\\1\\\\2\\\\3\\\\4\end{matrix} & \begin{pmatrix} 1 & 0 & 0 & 0 & 0 \\\\  1 / 3 & 1 / 3 & 1 / 3 & 0 & 0 \\\\  0 & 1 / 3 & 1 / 3 & 1 / 3 & 0 \\\\ 0 & 0 & 1 / 3 & 1 / 3 & 1 / 3 \\\\  0 & 0 & 0 & 0 & 1\end{pmatrix}\\\\ \end{matrix}$$

Then $\lim _{n \rightarrow \infty} p_{23}^{(n)}$ equals

1. $\frac{1}{3}$

2. $\frac{1}{2}$

3. 0

4. 1
in Probability by Expert | 905 views

Please log in or register to answer this question.

Welcome to Rational Solver, where you can ask questions and receive answers from other members of the community.
76 questions
33 answers
2 comments
1,801 users