YouTube13 Feb 2025
13m

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention

Podcast cover

Xiaol.x

Open in Podwise to generate AI notes

Sign in to process this episode and unlock summaries, transcripts, highlights and translations.

Open in Podwise

Shownotes are not generated by Podwise.

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention