Powers of the transition matrix and state vectors Problem set A

Each matrix has the states in the order A, B. Use your calculator.

1. (a) \(\mathbf{T} = \begin{pmatrix} 0.31 & 0.54 \\ 0.69 & 0.46 \end{pmatrix}\). Find the probability of being in state B after 3 steps, given that you start in A.
2. (b) \(\mathbf{T} = \begin{pmatrix} 0.74 & 0.41 \\ 0.26 & 0.59 \end{pmatrix}\). Find the probability of being in state A after 5 steps, given that you start in B.

\(\mathbf{T} = \begin{pmatrix} 0.48 & 0.17 & 0.28 \\ 0.31 & 0.62 & 0.12 \\ 0.21 & 0.21 & 0.6 \end{pmatrix}\), with the states in the order A, B, C. Find the probability of being in state C after 4 steps, given that you start in A.

\(\mathbf{T} = \begin{pmatrix} 0.63 & 0.09 & 0 & 0 \\ 0.19 & 0.52 & 0.24 & 0 \\ 0.11 & 0.28 & 0.58 & 0 \\ 0.07 & 0.11 & 0.18 & 1 \end{pmatrix}\), with the states in the order A, B, C, D. State D is absorbing.

1. (a) Find the probability of being in state D after 5 steps, given that you start in A.
2. (b) Find the probability of being in state B after 3 steps, given that you start in C.

\(\mathbf{T} = \begin{pmatrix} 0.77 & 0.32 \\ 0.23 & 0.68 \end{pmatrix}\) and \(\mathbf{s}_0 = \begin{pmatrix} 0.7 \\ 0.3 \end{pmatrix}\). Find \(\mathbf{s}_3\).

\(\mathbf{T} = \begin{pmatrix} 0.74 & 0.07 & 0.09 \\ 0.14 & 0.87 & 0.13 \\ 0.12 & 0.06 & 0.78 \end{pmatrix}\) and \(\mathbf{s}_0 = \begin{pmatrix} 0.4 \\ 0 \\ 0.6 \end{pmatrix}\). Find \(\mathbf{s}_4\).

For each transition matrix, say whether the chain is regular. If it is, find the smallest power of the matrix with every entry positive. If it is not, say why.

1. (a) \(\mathbf{T} = \begin{pmatrix} 0 & 0.6 \\ 1 & 0.4 \end{pmatrix}\), with two states.
2. (b) \(\mathbf{T} = \begin{pmatrix} 1 & 0.2 & 0 \\ 0 & 0.5 & 0 \\ 0 & 0.3 & 1 \end{pmatrix}\), with three states.
3. (c) \(\mathbf{T} = \begin{pmatrix} 0 & 0 & 1 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \end{pmatrix}\), with three states.

Three delivery companies, Atlas, Bolt and Core, have market shares of 45%, 35% and 20%. Each year customers move between the companies with transition matrix \(\mathbf{T} = \begin{pmatrix} 0.81 & 0.04 & 0.13 \\ 0.07 & 0.88 & 0.17 \\ 0.12 & 0.08 & 0.7 \end{pmatrix}\), in that order. Find the projected market share of each company after 4 years.

A city has three bike stations, A, B and C. At the end of each day a bike moves between stations with transition matrix \(\mathbf{T} = \begin{pmatrix} 0.66 & 0.21 & 0.09 \\ 0.22 & 0.52 & 0.35 \\ 0.12 & 0.27 & 0.56 \end{pmatrix}\), in that order. A bike is at station C on Monday evening. Find the probability that it is at station A on Thursday evening.

A gym has 1200 members. At the start, 800 use the morning session (M) and 400 the evening session (E). Each month the members change sessions with transition matrix \(\mathbf{T} = \begin{pmatrix} 0.88 & 0.34 \\ 0.12 & 0.66 \end{pmatrix}\), in the order M, E. Find the number of members in each session after 3 months.

The weather in a town is Sunny (S) or Rainy (R) each day. The transition matrix is \(\mathbf{T} = \begin{pmatrix} 0.8 & 0.4 \\ 0.2 & 0.6 \end{pmatrix}\), with the states in the order S, R. Monday is sunny.

1. (a) Find the probability that Tuesday is sunny and Wednesday and Thursday are both rainy.
2. (b) Find the probability that Thursday is rainy, whatever the weather on Tuesday and Wednesday.

Three shops A, B and C have shares of 60%, 30% and 10%. Each month the shares change with transition matrix \(\mathbf{T} = \begin{pmatrix} 0.77 & 0.11 & 0.06 \\ 0.16 & 0.81 & 0.14 \\ 0.07 & 0.08 & 0.8 \end{pmatrix}\), in that order. Find the first month in which shop C has a share of more than 25%.

\(\mathbf{T} = \begin{pmatrix} 0.46 & 0.13 & 0.24 \\ 0.33 & 0.58 & 0.27 \\ 0.21 & 0.29 & 0.49 \end{pmatrix}\), with the states in the order A, B, C.

1. (a) Find the probability of going from A to C in exactly two steps by adding the probabilities of the three routes.
2. (b) Check your answer by finding \(\mathbf{T}^2\) on your calculator.