10 Aug 2023
23m

AF - The positional embedding matrix and previous-token heads: how do they actually work? by Adam Yedidia

Podcast cover

The Nonlinear Library

Open in Podwise to generate AI notes

Sign in to process this episode and unlock summaries, transcripts, highlights and translations.

Open in Podwise

Shownotes are not generated by Podwise.

AF - The positional embedding matrix and previous-token heads: how do they actually work? by Adam Yedidia