Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference

Arxiv Papers - Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference