The Moonshot Alignment Program is a 5-week research sprint from August 2nd to September 6th, focused on the hard part of alignment: finding methods to get an AI to do what we want and not what don't want, which we have strong evidence will scale to superintelligence. You’ll join a small team, choose a vetted research direction, and run experiments to test whether your approach actually generalizes.

Mentors include: @Abram Demski @Cole Wyeth

Research Assistants include: Leonard Piff, Péter Trócsányi

Apply before July 27th. The first 300 applicants are guaranteed personalised feedback. 166 Applicants so far.

For this program, we have four main tracks:

Agent Foundations Theory: Build formal models of agents and value formation.
Applied Agent Foundations: Implement and test agent models.
Neuroscience-based AI Alignment: Design architectures inspired by how the brain encodes values.
Improved Preference Optimization: Build oversight methods that embed values deeply and scale [...]