Grounding through pure language modeling objectives, the origins or probing, the nature of understanding, the future of system assessment, signs of meaningful progress in the field, and having faith in yourself.

Transcript: https://web.stanford.edu/class/cs224u/podcast/pavlick/

Ellie's website
The LUNAR Lab
MIT Scientist Captures 90,000 Hours of Video of His Son’s First Words, Graphs It
Michael Frank
Spot robots
Dylan Ebert
Ian Tenney
What do you learn from context? Probing for sentence structure in contextualized word representations
BERT Rediscovers the Classical NLP Pipeline
JSALT: General-Purpose Sentence Representation Learning
Sam Bowman
Skip thought vectors
What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties
Hex
Charlie Lovering
Designing and interpreting probes with control tasks
Jerry Fodor
Been Kim
Mycal Tucker
What if this modified that? Syntactic interventions via counterfactual embeddings
Yonatan Belinkov
HANS: Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
Conceptual pacts and lexical choice in conversation
Locating and editing factual knowledge in GPT
Could a purely self-supervised language model achieve grounded language understanding?
Dartmouth Summer Research Project on Artificial Intelligence (1956)
Equal numbers of neuronal and nonneuronal cells make the human brain an isometrically scaled-up primate brain

Ellie Pavlick on true language understanding

CS224U

Ellie Pavlick on true language understanding