Sakana.ai: Extending the Context of Pretrained LLMs by Dropping Their Positional Embeddings

Open in Podwise to generate AI notes

Sign in to process this episode and unlock summaries, transcripts, highlights and translations.