Schedule

Plan Resources Assignments
Apr 1
  1. Course overview
    [video]
  2. Course set-up
  3. Jupyter notebook tutorial
  4. NumPy tutorial
  5. PyTorch tutorial
  1. Mitchell 2004
  2. Levesque 2013
  3. Manning 2015
  4. Potts 2019
  5. Video: The challenge and promise of artificial intelligence
  1. HW 1 due Apr 15, 4:30 pm
Apr 3
  1. Distributed word representations
    [video part 1; part 2; part 3]
  2. Designs, distances, basic reweighting
  3. Dimensionality reduction and representation learning
  4. Retrofitting
  5. Overview of HW1 and Bake-off 1
  6. Bake-off 1 report
  1. Screencast: Overview [slides]
  2. Screencast: Vector comparison [slides]
  4. Screencast: Reweighting [slides]
  6. Screencast: Dimensionality reduction [slides]
  7. Turney and Pantel 2010
  8. Lenci 2018
  9. Smith 2019
  10. Mikolov et al. 2013
  11. Pennington et al. 2014
  12. Faruqui et al. 2015
Apr 8
Apr 10
Apr 15
  1. Supervised sentiment analysis
    [video part 1; part 2]
  2. Overview of the Stanford Sentiment Treebank
  3. Hand-built feature functions
  4. Dense feature representations and neural networks
  5. Overview of HW2 and Bake-off 2
  6. Bake-off 2 report
  1. Pang and Lee 2008
  2. Socher et al. 2013
  3. Sentiment tutorial and resources
  4. Tutorial videos on supervised learning
  5. Stanford AI Lab Deep Learning Tutorial
  6. Goldberg 2015
  1. Bake-off 1 opens Apr 15 and closes Apr 17, 4:30 pm
  2. HW 2 due Apr 22, 4:30 pm
Apr 17
Apr 22
  1. Relation extraction with distant supervision: Task definition
    [video]
  2. Relation extraction with distant supervision: Experiments
  1. Jurafsky and Martin 2009, §22.1-22.2
  2. Snow et al. 2005
  3. Mintz et al. 2009
  1. Bake-off 2 opens Apr 22 and closes Apr 24, 4:30 pm
  2. HW 3 due Apr 29, 4:30 pm
Apr 24
  1. NLU in industry: A panel discussion with Guillaume Genthial and Marta Recasens
  2. Overview of HW3 and Bake-off 3
  3. Bake-off 3 report
Apr 29
  1. Natural language inference
    [video part 1; part 2]
  2. Tasks and datasets
  3. NLI models
  4. Overview of HW4 and Bake-off 4
  5. Bake-off 4 report
  1. Dagan et al. 2006
  2. MacCartney and Manning 2008
  3. Bowman et al. 2015a
  4. Bowman et al. 2015b
  5. Rocktäschel et al. 2015
  6. Williams et al. 2018
  1. Bake-off 3 opens Apr 29 and closes May 1, 4:30 pm
  2. HW 4 due May 6, 4:30 pm
May 1
May 6
  1. Grounded language understanding
    [video]
  1. Lewis et al. 2017
  2. Golland et al. 2010
  3. Andreas and Klein 2016
  4. Monroe et al. 2017
  5. Tellex, Knepper, et al. 2014
  6. Vogel et al. 2014
  1. Bake-off 4 opens May 6 and closes May 8
  2. Lit review due May 13, 4:30 pm
May 8
  1. Semantic parsing
    [video]
  2. SippyCup codebase
  3. SippyCup unit 0
  4. SippyCup unit 1
  5. SippyCup unit 2
  6. SippyCup unit 3
  1. Screencast: Core concepts for semantic parsing [slides]
  2. Screencast: Semantic parsing models [slides]
  3. Liang and Potts 2015
  4. Zettlemoyer & Collins 2005
  5. Liang et al. 2013
  6. Talk: Learning dependency-based compositional semantics (Percy Liang)
May 13
  1. Evaluation metrics
  2. Evaluation methods
  3. [video part 1; part 2]
  4. Evaluating NLU models with harder generalization tasks (Atticus)
  1. Domingos 2012
  2. Resnik and Lin 2010
  3. Smith 2011, Appendix B
  1. Experimental protocol due May 27, 4:30 pm
May 15
May 20
  1. Contextual word representations
    [video]
  2. Bringing contextual word representations into your models
  3. Representing long texts for NLU (Cindy)
  1. McCann et al. 2017
  2. Peters et al. 2018
  3. Vaswani et al. 2017
  4. Devlin et al. 2018
May 22
  1. NLU in industry: A panel discussion with David Hornik and Bill MacCartney
May 27
  1. Memorial Day (no class)
  1. Video presentations due Jun 5, 4:30 pm
May 29
  1. Writing up and presenting your work
    [video]
  2. Data augmentation (Min and Jayadev)
  3. Probing black box models (Akhila)
  1. Jason Eisner's Advice for Research Students
  2. Stuart Shieber on reporting research results
  3. David Goss on math style
Jun 3
  1. Project work (teams can sign up to meet with their teaching team mentors)
Jun 5
Jun 9

Final project due