Question

Emma has noticed a small red fox living in the park near her apartment. She takes a walk at the same time every day and has observed the fox in three different areas: in the woods, in the meadow, and by the pond.

If it is in the woods on one observation, then it is twice as likely to be in the woods as in the meadow on the next observation but not by the pond.

If it is in the meadow on one observation, then it is equally likely to be in any of the three locations on the next observation.

If it is by the pond on one observation, there is a 0.5 probability it will be by the pond on the next observation and will otherwise be in the woods.

When Emma went for a walk today, the red fox was in the woods.

a. Define the states and construct the transition matrix for this Markov chain.

b. Find the initial distribution vector for this Markov Chain.

c. Determine the probability that the red fox is in each of the three areas tomorrow.

Answer 1