Schedule
Schedule is tentative and will be updated throughout the quarter.
| Week | Date | Topic | Reading | Notes |
|---|---|---|---|---|
| 1 | 9/23 | Course overview & introduction (Otis) | On proof and progress in mathematics by Thurston Use of AI in mathematical research by Etingof |
— |
| 2 | 9/28 | Coding Basics (Shurui) | The Missing Semester of Your CS Education | Coding Basics agenda (PDF) WSL guide for Windows users Basic terminal and guide to overleaf via git and codex CLI |
| 9/30 | Coding Basics (Shurui) | |||
| 3 | 10/5 | Deep Learning (Otis) | — | ML basics (Google Colab made by Otis) |
| 10/7 | Deep Learning (Fred) | — | — | |
| 4 | 10/12 | LLM Architecture (Shurui, Fred, Henry) | — | — |
| 10/14 | LLM Architecture (Shurui, Fred, Henry) | — | — | |
| 5 | 10/19 | CoT Reasoning + o1/R1 Paper Ethos | — | — |
| 10/21 | CoT Reasoning + o1/R1 Paper Ethos | — | — | |
| 6 | 10/26 | Agents (Shurui) | — | — |
| 10/28 | Agents (Shurui) | — | — | |
| 7 | 11/2 | Formalization/Lean Basics (Fred) | — | — |
| 11/4 | Formalization/Lean Basics (Fred) | — | — | |
| 8 | 11/9 | Practical Aspects (Henry) | — | — |
| 11/11 | Practical Aspects (Henry) | — | — | |
| 9 | 11/16 | Final Project Presentations | — | — |
| 11/18 | Final Project Presentations | — | — | |
| 10 | 11/23 | Final Project Presentations | — | — |
| 11/25 | Final Project Presentations | — | — |
Tentative Syllabus
- Coding Basics (Week 2)
- Terminal/shell/IDE/server
- Python, pip/uv (virtual environments)
- NumPy / PyTorch
- Git/GitHub
- How to use coding agents to write code
- Security
- Hugging Face Transformers library
- Weights & Biases (Modal)
- Sandbox, permissions, config
- Deep Learning
- Neural Networks
- Optimizers
- LLM Architecture
- Tokenizer
- Embedding
- Attention + MLP layers
- MoE
- Decoder/sampling
- CoT Reasoning + o1/R1 Paper Ethos
- RL
- Agents
- Prompt/context engineering
- Agentic engineering
- Coding Agents
- Skills
- Agentic Memory
- Formalization/Lean Basics
- Lean crash course + kernel
- Practical Aspects
- GPUs (memory, FLOPs)
- Cost estimation
- API spend
- GPU costs
- How to estimate cost for a certain task
- Roofline model