Schedule and Syllabus

Unless otherwise specified the course lectures and meeting times are:

Tuesday, Thursday 4:30-5:50
Location: NVIDIA Auditorium
EventDateDescriptionCourse Materials
Lecture Jan 10 Intro to NLP and Deep Learning Suggested Readings:
  1. [Linear Algebra Review]
  2. [Probability Review]
  3. [Convex Optimization Review]
  4. [More Optimization (SGD) Review]
[python tutorial]
Lecture Jan 12 Simple Word Vector Representations Suggested Readings:
  1. [Word2Vec Tutorial - The Skip-Gram Model]
  2. [Distributed Representations of Words and Phrases and their Compositionality]
  3. [Efficient Estimation of Word Representations in Vector Space]
Spotlight: [slides] [paper]
A1 released Jan 12 Assignment #1 released [Assignment 1]
Lecture Jan 17 Advanced Word Vector Representations Suggested Readings:
  1. [GloVe: Global Vectors for Word Representation]
  2. [Improving Distributional Similarity with Lessons Learned fromWord Embeddings]
  3. [Evaluation methods for unsupervised word embeddings]
Spotlight: [slides] [paper]
Lecture Jan 19 Word Window Classification and Neural Networks Suggested Readings:
  1. cs231n notes on [backprop] and [network architectures]
  2. [Natural Language Processing (almost) from Scratch]
  3. [Learning Representations by Backpropogating Errors]
Lecture Jan 24 Project Advice, Neural Net Details and Practical Tips
Lecture Jan 26 Dependency Parsing
A1 Due Jan 26 Assignment #1 due
A2 Released Jan 26 Assignment #2 released
Lecture Jan 31 Introduction to TensorFlow
Lecture Feb 2 Recurrent Neural Networks and Language Modeling
Lecture Feb 7 RNNs/LSTMs/GRUs
Review Feb 9 Midterm Review
Project Proposal Due Feb 9 Final project proposal due
A2 Due Feb 9 Assignment #2 due
A3 Released Feb 9 Assignment #3 released
Midterm Feb 14 In-class midterm
Lecture Feb 16 Seq2Seq and Attention Mechanisms
Lecture Feb 21 Neural Machine Translation
Lecture Feb 23 Speech Processing
A3 Due Feb 23 Assignment #3 due
A4 Released Feb 23 Assignment #4 released Default final project
Lecture Feb 28 Convolutional and Recursive Neural Nets
Lecture Mar 2 Constituency Parsing
Lecture Mar 7 Coreference Resolution
Lecture Mar 9 Natural Language Understanding
Lecture Mar 14 Question Answering
Lecture Mar 16 Dynamic Memory Networks and Other New Architectures
Final Project Due Mar 17 Final course project / Assignment #4 due
Poster Presentation Mar 21 Final project poster presentations 12:15-3:15, location TBD