Markov Models

Most of the models illustrated so far are static. That is, each time you press F9 to recalculate, you get the same solution. Markov models are dynamic. Each time your recalculate the solution changes in a predictable way.

Assume you have two buckets. The first bucket contains 100 marbles and the second bucket contains none. Every minute you take half of the marbles in the first bucket and put them in the second bucket. This is a Markov system. You know that the initial state of the system is 100 marbles in bucket one and none in bucket two. You also know that if you let the system run long enough, all of the marbles will be in the second bucket. However, what is more interesting is what happens in the intervening stages.

See Also

Markov Example

State Graphs

Health Insurance Pool Example