Stochastic Markov chain – Wikipedia, the free encyclopedia March 20, 2015 tomix http://en.m.wikipedia.org/wiki/Markov_chain