CS 224G

Apps with LLMs Inside

Winter 2024

Course Schedule

Date Topic Description Events Deadlines
1/9 Introduction and Project Logistics Why are LLMs are exciting right now; where we are today in LLMs; what makes now unique; how to explore this new frontier; opportunities; course logistics.
1/11 Project Pitches Students get a chance to pitch their project ideas and recruit teammates. Project mini-pitch due
1/16 Team Building & More Project Pitches Students continue pitching and forming teams. Final Project Proposal due
1/18 About LLMs, LMMs Langage modeling; Shortfalls of pre-trained LMs; hallucination and practical challenges Final Project Team due
1/23 AI Models and Scalable Apps AI model scalability, costs; emergence, roadmap for prompting Sprint 1 Start
1/25 Agile Development and Prompts Agile approach to develop prompts; examples; strengths & weaknesses
1/30 Baseten Demo, Assembling Prompts Benefits & shortfalls of open source models; Baseten model deployment w/Truss; examples of prompts in production
2/1 Sprint 1 Presentations Groups present their progress on Sprint 1. Sprint 1 End
2/6 Practical Guide to Prompt LLMs Guest lecture by Vijay Parthasarathy, Head of AI @ Zoom Sprint 2 Start
2/8 MLOps & LLMOps with Hamilton Guest lecture by Stefan Krawczyk, CEO @ DAGWorks
2/13 Demystifying LLMs Guest lecture by Devendra Chaplot, AI Research Scientist @ Mistral AI
2/15 Sprint 2 Presentations Groups present their progress on Sprint 2. Sprint 2 End
2/20 Large Model Quality and Evaluation Guest lecture by Anoop Sinha, Research Director @ Google Sprint 3 Start
2/22 LLMs for Code Generation Guest lecture by Josh Payne, Founder @ Coframe
2/27 Working with LLMs Guest lecture by Shashaank Shekhar Singhal, Head of Product for Conversational AI @ Uber & Arindam Bhattacharya, Staff Machine Learning Engineer @ Uber
2/29 Sprint 3 Presentations Groups present their progress on Sprint 3. Sprint 3 End
3/5 Full Stack LLMs Guest lecture by Anirban Das, Capital One Sprint 4 Start
3/7 LLMs and Safety Guest lecture by Max Lamparth, Stanford
3/12 LLM Guardrails; How to Give an Effective Pitch Guest lecture by Shreya Rajpal, CEO @ Guardrails AI for the first half; John Whaley for the second half
3/14 Final project presentation Groups present their final projects. Sprint 4 End
Final Project Report + Code + (recommended) video demo Due 3/15