Lecture 17: Markov Chains - II

« Previous | Next »

Lecture Topics

Review Steady-state behavior Steady-state convergence theorem Balance equations Birth-death process

Lecture Activities

• Watch the Lecture 17: Markov Chains - II Video

  Flash and JavaScript are required for this feature.

  Lecture 17 Video

  > Download from iTunes U (MP4 - 112MB)

  > Download from Internet Archive (MP4 - 112MB)

  > Download this transcript - PDF English - US

  > Download English - US subtitle (SRT)

  by Prof. Tsitsiklis (00:51:25)
• Review the Lecture 17: Markov Chains - II Slides (PDF)
• Read Section 7.3 in the textbook

Tutorial Problems

Review the tutorial problems in the PDF file below and try to solve them on your own.

• Tutorial 9 Problems (PDF) Do ONLY Problem 3
• Tutorial 9 Solutions (PDF)

Problem Set and Solutions

Work the problems on your own and check your answers when you're done. Problem set 8 covers Lectures 16 and 17.

• Problem Set 8 (PDF)
• Problem Set 8 Solutions (PDF)

« Previous | Next »