Only the US can make us ready for AGI, but Europe just made us readier.

Cross-posted from the AI Futures blog.

We’ve previously written about what an individual can do to make the development of transformative AI less likely to end in disaster. How about an AGI company?[1] What steps should they take right now to prepare for crunch time?

The first thing we’d recommend an AGI company do is to coordinate with other companies and with governments to stop the reckless race toward superintelligence. Failing that, our backup recommendation would be for an AGI company to invest in planning and transparency.

We expect that during takeoff, leading AGI companies will have to make high-stakes decisions based on limited evidence under crazy time pressure. As depicted in AI 2027, the leading American AI company might have just weeks to decide whether to hand their GPUs to a possibly [...]

---

Outline:

(00:14) Only the US can make us ready for AGI, but Europe just made us readier.

(05:51) A brief history of AGI companies' safety commitments

(09:53) Introducing the GPAI Code of Practice

(19:44) Will the Code matter at crunch time?

(23:46) Building on the Code

The original text contained 8 footnotes which were omitted from this narration.

---

First published:
September 22nd, 2025

Source:
https://www.lesswrong.com/posts/vo7oyD42W8JEq4XdB/the-world-s-first-frontier-ai-regulation-is-surprisingly

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Political cartoon showing EU bridge under construction reaching toward AGI cliff.

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

“The world’s first frontier AI regulation is surprisingly thoughtful: the EU’s Code of Practice” by MKodama

LessWrong (30+ Karma)

“The world’s first frontier AI regulation is surprisingly thoughtful: the EU’s Code of Practice” by MKodama