Ellie Pavlick on true language understanding

Mon, 09 May 2022 15:15:00 -0700

Grounding through pure language modeling objectives, the origins or probing, the nature of understanding, the future of system assessment, signs of meaningful progress in the field, and having faith in yourself.

Transcript: https://web.stanford.edu/class/cs224u/podcast/pavlick/

Ellie's website

The LUNAR Lab

MIT Scientist Captures 90,000 Hours of Video of His Son’s First Words, Graphs It

Michael Frank

Spot robots

Dylan Ebert

Ian Tenney

What do you learn from context? Probing for sentence structure in contextualized word representations

BERT Rediscovers the Classical NLP Pipeline

JSALT: General-Purpose Sentence Representation Learning

Sam Bowman

Skip thought vectors

What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties

Hex

Charlie Lovering

Designing and interpreting probes with control tasks

Jerry Fodor

Been Kim

Mycal Tucker

What if this modified that? Syntactic interventions via counterfactual embeddings

Yonatan Belinkov

HANS: Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference

Conceptual pacts and lexical choice in conversation

Locating and editing factual knowledge in GPT

Could a purely self-supervised language model achieve grounded language understanding?

Dartmouth Summer Research Project on Artificial Intelligence (1956)

Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled-up primate brain