Schedule

Plan Resources Assignments
Apr 1
  1. Course overview
  2. Course set-up
  3. Jupyter notebook tutorial
  1. Mitchell 2004
  2. Levesque 2013
  3. Manning 2015
  4. Potts 2019
  5. Video: The challenge and promise of artificial intelligence
  1. HW 1 due Apr 15, 4:30 pm
Apr 3
  1. Distributed word representations
  2. Designs, distances, basic reweighting
  3. Dimensionality reduction and representation learning
  4. Retrofitting
  5. Overview of HW1 and Bake-off 1
  1. Screencast: Overview [slides]
  2. Screencast: Vector comparison [slides]
  3. Screencast: Reweighting [slides]
  4. Screencast: Dimensionality reduction [slides]
  5. Turney and Pantel 2010
  6. Lenci 2018
  7. Smith 2019
  8. Mikolov et al. 2013
  9. Pennington et al. 2014
  10. Faruqui et al. 2015
Apr 8
Apr 10
Apr 15
  1. Supervised sentiment analysis
  2. Overview of the Stanford Sentiment Treebank
  3. Hand-built feature functions
  4. Dense feature representations and neural networks
  5. Overview of HW2 and Bake-off 2
  1. Pang and Lee 2008
  2. Socher et al. 2013
  3. Sentiment tutorial and resources
  4. Tutorial videos on supervised learning
  5. Stanford AI Lab Deep Learning Tutorial
  6. Goldberg 2015
  1. Bake-off 1 opens Apr 15 and closes Apr 17, 4:30 pm
  2. HW 2 due Apr 22, 4:30 pm
Apr 17
Apr 22
  1. Relation extraction
  2. Relation extraction with distant supervision: Task definition
  3. Relation extraction with distant supervision: Experiments
  1. Jurafsky and Martin 2009, §22.1-22.2
  2. Snow et al. 2005
  3. Mintz et al. 2009
  1. Bake-off 2 opens Apr 22 and closes Apr 24, 4:30 pm
  2. HW 3 due Apr 29, 4:30 pm
Apr 24
  1. NLU in industry: A panel discussion with Guillaume Genthial and Marta Recasens
  2. Overview of HW3 and Bake-off 3
Apr 29
  1. Natural language inference
  2. Tasks and datasets
  3. NLI models
  4. Overview of HW4 and Bake-off 4
  5. Lifelong learning (Ignacio)
  1. Dagan et al. 2006
  2. MacCartney and Manning 2008
  3. Bowman et al. 2015a
  4. Bowman et al. 2015b
  5. Rocktäschel et al. 2015
  6. Williams et al. 2018
  1. Bake-off 3 opens Apr 29 and closes May 1, 4:30 pm
  2. HW 4 due May 6, 4:30 pm
May 1
May 6
  1. Grounded language understanding
  1. Lewis et al. 2017
  2. Golland et al. 2010
  3. Andreas and Klein 2016
  4. Monroe et al. 2017
  5. Tellex, Knepper, et al. 2014
  6. Vogel et al. 2014
  1. Bake-off 4 opens May 6 and closes May 8
  2. Lit review due May 13, 4:30 pm
May 8
  1. Semantic parsing
  2. SippyCup codebase
  3. SippyCup unit 0
  4. SippyCup unit 1
  5. SippyCup unit 2
  6. SippyCup unit 3
  1. Screencast: Core concepts for semantic parsing [slides]
  2. Screencast: Semantic parsing models [slides]
  3. Liang and Potts 2015
  4. Zettlemoyer & Collins 2005
  5. Liang et al. 2013
  6. Talk: Learning dependency-based compositional semantics (Percy Liang)
May 13
  1. Evaluation metrics
  2. Evaluation methods
  3. Generalization and adversarial testing (Atticus)
  1. Domingos 2012
  2. Resnik and Lin 2010
  3. Smith 2011, Appendix B
  1. Experimental protocol due May 27, 4:30 pm
May 15
May 20
  1. Contextual word representations
  2. Bringing contextual word representations into your models
  3. Summary representations of long texts (Cindy)
  1. McCann et al. 2017
  2. Peters et al. 2018
  3. Vaswani et al. 2017
  4. Devlin et al. 2018
May 22
  1. NLU in industry
  2. Data augmentation (Min and Jayadev)
May 27
  1. Memorial Day (no class)
  1. Video presentations due Jun 5, 4:30 pm
May 29
  1. Writing up and presenting your work
  2. Probing black box models (Akhila)
  1. Jason Eisner's Advice for Research Students
  2. Stuart Shieber on reporting research results
  3. David Goss on math style
Jun 3
  1. Project work (teaching team available in the classroom)
Jun 5
Jun 9

Final project due