RADLADS: Rapid Attention Distillation to Linear Attention Decoders at Scale

Latent Space TV (see @LatentSpacePod for Pod) - RADLADS: Rapid Attention Distillation to Linear Attention Decoders at Scale