Reading and Course Material – Markov Processes

Background Material

Lecture Notes

Introduction to Markov Processes

Further Reading

  • Markov Chains. J. R. Norris. Cambridge University Press, 1997