Markov Processes and Risk

In this lab you will create some transition matrices and use MATLAB to study how the probability distribution changes over time. This is all in preparation for you to do the 2nd Risk assignment.ccollins@math.utk.eduSimple Dice GameRoll a single die getting the numbers 1 thru 5 in order, if you roll a 6 before you get to 5, you have to start over. There are 6 states you can be in: have nothing, have 1, 2, 3, 4, 5. Let's number these 0, 1, 2, 3, 4, 5. Here's the transition matrix for this game: 0 1 2 3 4 5 0 5/6 1/6 1/6 1/6 1/6 0 1 1/6 4/6 0 0 0 0 2 0 1/6 4/6 0 0 0 3 0 0 1/6 4/6 0 0 4 0 0 0 1/6 4/6 0 5 0 0 0 0 1/6 1 Enter this in MATLAB, call itT(don't enter the indices 0-5) To check it typesum(T)you should get all 1s. LetP = [1; 0; 0; 0; 0; 0]this is your starting distribution. Now if you typeT*Pyou get the distribution after one turn. If you typeT^2*Pyou get the distribution after two turns. If you typeT^3*Pyou get the distribution after three turns.Questions:(Either e-mail the answers to me, or hand them in) 1. What is the probability that you will be back at 0 after 3 turns? 2. What is the probability that you will be back at 0 after 10 turns? 3. What is the probability that you have reached 5 after 10 turns? 4. What is the average score obtained after 10 turns? (Expected Value) 5. How many turns before the probability that you have reached 5 exceeds 1/2?Cootie(Send the answers to me) 1. List all the possible states you could be in during a game of Cootie. Some examples: (Body, Head), (Body, Head, Legs), (Body, Tail) 2. Assume you have Body, Head, Eyes and Ears. Write out the transition matrix between all the states with at least Body, Head, Eyes and Ears (there are 4 such states). 3. If you have Body, Head, Eyes and Ears, what is the expected number of turns until you have a complete Cootie? Hint: take the transition matrixTfrom 2. and the right starting distributionP. IfP(4)is the probability of have a complete Cootie, then the 4th component ofT*Pis the prob. after 1 turn,T^2*Pafter 2 turns and so on. The expected value is the sum of the number of turns times the probability of success at that turn.RiskDo the assignment on today's handout about the game of Risk, bring the results on Monday. E-mail: ccollins@math.utk.edu