One Step of Gradient Descent is Provably the Optimal In-Context Learner with Linear Self-Attention

Xiaol.x - One Step of Gradient Descent is Provably the Optimal In-Context Learner with Linear Self-Attention