Adina Williams on deep linguistic analysis in NLP

Wed, 20 Apr 2022 15:15:00 -0700

Neuroscience and neural networks, being a linguist in the world of NLP, evaluation methods, fine-grained NLI questions, the pace of research, and the vexing fact that, on the internet, people = men.

Transcript: https://web.stanford.edu/class/cs224u/podcast/williams/

Adina's website

Adina on Twitter

Based on billions of words on the internet, people = men

April Bailey

Andrei Cimpian

Androcentrism

GloVe

fastText

Preregistration

P-hacking

Rishi Bommasani

Interpreting pretrained contextualized representations via reductions to static embeddings

Common Crawl

Battlestar Galactica

MultiNLI

ANLI

DynaBench

Breaching experiment

Liina Pylkkänen

Sam Bowman

Nikita Nangia

Ludwig Wittgenstein

Ido Dagan

Sebastian Riedel

SNLI

Yixin Nie

Douwe Kiela

Jason Weston

Emily Dinan

Build it break it fix it for dialogue safety: Robustness from adversarial human attack

Allyson Ettinger

GLUE

DynaSent

DeBERTa

RoBERTa

Breaking NLI systems with sentences that require simple lexical inferences

HANS: Right for the wrong reasons: Diagnosing syntactic heuristics in natural language inference

Targeted syntactic evaluation of language models

Max Bartolo

Magnetoencephalography

Marr's Levels

Marco Baroni

Richard Futrell

Ryan Cotterell

SIGMORPHON 2022

Alexis Conneau

FLORES

XNLI

OCNLI: Original Chinese natural language inference

Yann LeCun

Novel Ideas in Learning-to-Learn through Interaction

Grounding semantics in olfactory perception

Brain in a vat

Ellie Pavlick

Tom Kwiatkowski

Mohit Bansal

Identifying inherent disagreement in natural language inference

DALL-E 2

Winoground

Gary Marcus on Winoground