Xiaol.x - SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention
Sign in to continue reading, translating and more.