"The Cognitive Revolution"
The Neuron Basis: Goodfire's Curt Tigges on Agentic Interp, Monosemanticity & Reverse Engineering
AI summary Individual neurons in modern large language models, particularly within gated MLP architectures like SWIGLU, exhibit significantly higher interpretability than previously assumed. Rather than functioning as a chaotic, distributed mess, most neurons serve specific, identifiable…
- Neurons as an Interpretable Basis
- Neural Networks are Already Clean
- Sparse Autoencoders (SAE)
1 h 56 minEnglishSummary · Transcript
