Schedule

Meeting Times

Unless otherwise specified the course meeting times are:

Monday, Wednesday 11:30 AM - 12:50 PM on Zoom

Schedule And Course Materials

The preliminary schedule is given below and is subject to change. Pre-recorded lecture videos will be available by the end of Sunday the week before class. Each week's materials (videos and slides) can be found in modules page.

On Mondays during class time, we will have optional lecture watch party with CA support. On Wednesdays during class time, we will have optional CA-lead session to go through worked examples about the material and also practice working on materials in breakout rooms with CA support. We will include all links for sessions, assignments, and quizzes in this schedule page. Please check back regularly for updates!

Monday Tuesday Wednesday Thursday Friday Saturday Sunday
Jan 11 Jan 12 Jan 13 Jan 14 Jan 15 Jan 16 Jan 17
Introduction to RL Tabular MDP Planning Quiz 0
Due at 6 pm

Jan 18 Jan 19 Jan 20 Jan 21 Jan 22 Jan 23 Jan 24
Martin Luther King, Jr., Day (No class) Tabular RL Policy Evaluation Assignment 1
Due at 6 pm
Jan 25 Jan 26 Jan 27 Jan 28 Jan 29 Jan 30 Jan 31
Q-Learning Function Approximation

Quiz 1
Due at 6 pm

Feb 1 Feb 2 Feb 3 Feb 4 Feb 5 Feb 6 Feb 7
Function Approximation Function Approximation Assignment 2 Part 1
Due at 6 pm

Feb 8 Feb 9 Feb 10 Feb 11 Feb 12 Feb 13 Feb 14
Policy Search Policy Search Assignment 2 Part 2
Due at 6 pm
Feb 15 Feb 16 Feb 17 Feb 18 Feb 19 Feb 20 Feb 21
Presidents' Day (No Class) Imitation Learning or Exploration Quiz 2
Due at 6 pm

Feb 22 Feb 23 Feb 24 Feb 25 Feb 26 Feb 27 Feb 28
Exploration / Exploitation Exploration / Exploitation Assignment 3
Due at 6 pm
Mar 1 Mar 2 Mar 3 Mar 4 Mar 5 Mar 6 Mar 7
Batch RL Guest Lecture Quiz 3
Due at 6 pm

Mar 8 Mar 9 Mar 10 Mar 11 Mar 12 Mar 13 Mar 14
Monte Carlo Tree Search Multi-agent RL
Mar 15 Mar 16 Mar 17 Mar 18 Mar 19 Mar 20 Mar 21
Wrap Up

Assignment 4
Due at 6 pm

TBD