Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.

I call "alignment strategy" the high-level approach to solving the technical problem[1]. For example, value learning is one strategy, while delegating alignment research to AI is another. I call "alignment metastrategy" the high-level approach to converging on solving the technical problem in a manner which is timely and effective. (Examples will follow.)

In a previous article, I summarized my criticism of prosaic alignment. However, my analysis of the associated metastrategy was too sloppy. I will attempt to somewhat remedy that here, and also briefly discuss other metastrategies, to serve as points of contrast and comparison.

Conservative Metastrategy

The conservative metastrategy follows the following algorithm:

As much as possible, stop all work on AI capability outside of this process.
Develop the mathematical theory of intelligent agents to a level where we can propose adequate alignment protocols [...]

---

Outline:

(00:50) Conservative Metastrategy

(02:28) Incrementalist Metastrategy

(03:42) Information Security

(03:46) Design

(05:24) Implementation

(06:04) Measuring Alignment

(06:08) Design

(08:15) Implementation

(08:56) Unpredictable Progress

(10:35) Butlerian Metastrategy

(11:26) Transhumanist Metastrategy

The original text contained 5 footnotes which were omitted from this narration.

---

First published:
December 31st, 2023

Source:
https://www.lesswrong.com/posts/TALmStNf6479uTwzT/ai-alignment-metastrategy

---

Narrated by TYPE III AUDIO.

“AI Alignment Metastrategy” by Vanessa Kosoy

LessWrong (30+ Karma)

“AI Alignment Metastrategy” by Vanessa Kosoy