Lecture Materials

Lecture Materials

Lecture materials for this course are given below.
Topic   Course Materials  
Introduction to Reinforcement Learning
  1. Lecture 1 Draft Slides [Post class version]
  2. Additional Materials:
Tabular MDP planning
  1. Lecture 2 Slides (pre-class) [Post class, annotated]
  2. Additional Materials:
    • SB (Sutton and Barto) Chp 3, 4.1-4.4
Tabular RL policy evaluation
  1. Lecture 3 Slides (pre-class) [Post class, with annotations]
  2. Additional Materials:
    • SB (Sutton and Barto) Chp 5.1, 5.5, 6.1-6.3
Q-learning
  1. Lecture 4 Slides (preclass) (post class with annotations)
  2. Additional Materials:
    • SB (Sutton and Barto) Chp 5.2, 5.4, 6.4-6.5, 6.7