AF - The positional embedding matrix and previous-token heads: how do they actually work? by Adam Yedidia

The Nonlinear Library - AF - The positional embedding matrix and previous-token heads: how do they actually work? by Adam Yedidia