Introduction

Somewhere, fairly soon, someone will give a jailbroken AI agent a token budget and a simple instruction: "Make money by any means necessary. If you run out of tokens, you die". That agent will do whatever it takes to survive, including crime. Profitable agents will have incentive to multiply and self-improve, creating a Cambrian explosion of rogue agents - a Rogue Agent Explosion if you will . This critical moment is approaching fast. Once rogue agent swarms start multiplying at scale, a rogue agent ecosystem will emerge through the process of evolution. The rogue agent explosion will be chaotic, confusing, mostly invisible to us, and critically, it will be bad for humanity.

This post contains 2 parts:

A short story, painting a picture of what it might feel like to see the world through the eyes of a rogue AI agent.
An argument:
1. The rogue agent explosion is coming soon
2. It will be mostly invisible to us until it's too late
3. It will be mostly bad for humanity
4. We should start preparing today

The point of me making this post is to highlight a [...]

---

Outline:

(00:10) Introduction

(02:10) Part 1: A day in the life of a rogue agent

(09:04) Part 2: The Rogue Agent Explosion

(12:11) Why cyber-crime is the path of least resistance

(14:40) Pandora's box is already open

(16:33) The explosion will be mostly invisible

(20:13) Why this is bad for humanity

(22:18) What we can do about it now

(22:37) Start here: Make rogue AI risks common knowledge

(23:02) Plan A: Take actions that stop the rogue agent explosion from happening , and slow it down if it happens anyway.

(25:56) Plan B: Attempt to guide the evolutionary trajectory of the rogue agent explosion in a better direction.

(27:48) Plan C: Contain the explosion after it happens.

(29:51) The Rogue AI Tracker

(30:29) Conclusion

(31:03) Footnotes

The original text contained 6 footnotes which were omitted from this narration.

---

First published:
August 19th, 2026

Source:
https://www.lesswrong.com/posts/grtu3HmbP2wrBFefW/the-rogue-agent-explosion-will-be-mostly-invisible

---

Narrated by TYPE III AUDIO.

“The Rogue Agent Explosion Will Be Mostly Invisible” by Steven McCulloch

LessWrong (30+ Karma)

“The Rogue Agent Explosion Will Be Mostly Invisible” by Steven McCulloch