09 Apr 2024
31m

LW - Gated Attention Blocks: Preliminary Progress toward Removing Attention Head Superposition by cmathw

Podcast cover

The Nonlinear Library

Open in Podwise to generate AI notes

Sign in to process this episode and unlock summaries, transcripts, highlights and translations.

Open in Podwise

Shownotes are not generated by Podwise.

LW - Gated Attention Blocks: Preliminary Progress toward Removing Attention Head Superposition by cmathw