MARKOV PROCESSES. - Miller, Douglas R. (Encyclopedia of Operations Research & Management Science, 2001)