Section outline


    • Overview Page
      Students must
      Mark as done

      In our previous topic, we witnessed the involvement of probabilistic statements in the occurrence of our events, to further investigate this phenomenon, we study Markov process models.  They are useful in studying the evolution of systems over repeated trials or sequential time periods or stages.  They have been used to describe the probability in the following scenarios: 

      1. A machine that is functioning in one period will continue to function or break down in the next period.
      2. A consumer purchasing brand A in one period will purchase brand B in the next period
      The learning outcome in this topic is to model a problem in a Markov process and solve the problem as well as interpret the results.

    • Markov Models File
      Students must
      Mark as done
    • Discussion Forum
      Students must
      Mark as done

      Further to the example on slide #15: A rat is placed in the maze of the figure. In room 1 is a cat and in room 4 is a piece of cheese. If the rat enters either of these rooms he does not leave it. If he is in one of the other rooms, each time period he chooses at random one of the doors of the room he is in and moves into another room.  If the rat starts out in Room 3, estimate the probability he winds up in room 1? Room 4?