This is a link post.

He starts by emphasizing

The issue is so hotly debated because the stakes are major: According to some estimates, quadrillions of dollars of net present value are up for grabs, not to mention political power great enough to significantly disrupt the current world order.

[...]

The most important thing to realize, through all the noise of discussions and debates, is a very simple and indisputable fact: while we are racing towards AGI or even ASI, nobody currently knows how such an AGI or ASI could be made to behave morally, or at least behave as intended by its developers and not turn against humans.

And goes on to do a pretty great job addressing "those who think

AGI and ASI are impossible or are centuries in the future
AGI is possible but only in many decades
that we may reach AGI but not ASI [...]

---

First published:
July 11th, 2024

Source:
https://www.lesswrong.com/posts/ndvtiaqZErjnermWF/yoshua-bengio-reasoning-through-arguments-against-taking-ai

---

Narrated by TYPE III AUDIO.

“Yoshua Bengio: Reasoning through arguments against taking AI safety seriously” by Judd Rosenblatt

LessWrong (30+ Karma)