Efficient Length-Generalizable Attention via Causal Retrieval for Long-Context Language Modeling

Xiaol.x - Efficient Length-Generalizable Attention via Causal Retrieval for Long-Context Language Modeling