Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting

Arxiv Papers - Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting