Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.

TL;DR: Scaling labs have their own alignment problem analogous to AI systems, and there are some similarities between the labs and misaligned/unsafe AI.

Introduction.

Major AI scaling labs (OpenAI/Microsoft, Anthropic, Google/DeepMind, and Meta) are very influential in the AI safety and alignment community. They put out cutting-edge research because of their talent, money, and institutional knowledge. A significant subset of the community works for one of these labs. This level of influence is beneficial in some aspects. In many ways, these labs have strong safety cultures, and these values are present in their high-level approaches to developing AI – it's easy to imagine a world in which things are much worse. But the amount of influence that these labs have is also something to be cautious about.

The alignment community is defined by a [...]

---

Outline:

(02:02) Misaligned Incentives

(02:43) Power Seeking

(03:30) Lack of Transparency

(04:30) Deception

(05:18) Incorrigibility

(06:03) Subverting Constraints

(06:21) Concluding Thoughts

---

First published:
February 21st, 2024

Source:
https://www.lesswrong.com/posts/fpws8WNo6Mp4KsQjH/analogies-between-scaling-labs-and-misaligned

---

Narrated by TYPE III AUDIO.

“Analogies between scaling labs and misaligned superintelligent AI” by scasper

LessWrong (30+ Karma)