Please answer all parts of the following question. Please show all work and all steps.
1a.) Let Xn be a Marcov chain with the states S = {0,1} starting from 0. The transition probability is given by
p = ( 1/3 2/3)
1/2 1/2
Compute P(X2=1) and compute P(X3=0 given X2=1)
1b.) Suppose that T1 and T2 are stopping times. Determine whether the following are stopping time or not: (1) T1 + T2, (2) T1 − 1 (assuming T1 ≥ 1), (3) max(T1, T2), (4) min(T1, T2).
Get Answers For Free
Most questions answered within 1 hours.