Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.

https://www.science.org/doi/10.1126/science.adn0117

Authors:

Yoshua Bengio, Geoffrey Hinton, Andrew Yao, Dawn Song, Pieter Abbeel, Yuval Noah Harari, Ya-Qin Zhang, Lan Xue, Shai Shalev-Shwartz, Gillian Hadfield, Jeff Clune, Tegan Maharaj, Frank Hutter, Atılım Güneş Baydin, Sheila McIlraith, Qiqi Gao, Ashwin Acharya, David Krueger, Anca Dragan, Philip Torr, Stuart Russell, Daniel Kahneman, Jan Brauner*, Sören Mindermann*

Abstract:

Artificial intelligence (AI) is progressing rapidly, and companies are shifting their focus to developing generalist AI systems that can autonomously act and pursue goals. Increases in capabilities and autonomy may soon massively amplify AI's impact, with risks that include large-scale social harms, malicious uses, and an irreversible loss of human control over autonomous AI systems. Although researchers have warned of extreme risks from AI, there is a lack of consensus about how to manage them. Society's response, despite promising first steps, is incommensurate with [...]

---

First published:
May 23rd, 2024

Source:
https://www.lesswrong.com/posts/82f3o2SuS3pwaZt8Y/paper-in-science-managing-extreme-ai-risks-amid-rapid

---

Narrated by TYPE III AUDIO.

“Paper in Science: Managing extreme AI risks amid rapid progress” by JanB

LessWrong (30+ Karma)