This new edition is expanded and updated, complete with end-of-chapter exercises. Outlines the recent development of Markov chain models for modeling queueing systems, manufacturing and re-manufacturing systems, inventory systems and financial risk management.