SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inference

Xiaol.x - SpargeAttention: Accurate and Training-free Sparse Attention Accelerating Any Model Inference