Intended for a broad audience.[1]

My belief is that keeping AI under human control would be an unprecedented global challenge, if it's even possible at all.

Many other people's believe that AIs will naturally remain as tools under human control. Either they see this as inevitable—“how could it be otherwise?”—or they see it as not quite inevitable, but still an outcome that can easily happen via ordinary government regulations, civil society, and so on.

Who's right? What's the right way to think about this?

This is an issue where people really don’t see eye-to-eye, and tend to get stuck endlessly talking past each other. To pin down the disagreement, I think that the following is a good conversation-starter:

Conversation-starting question: Do you expect almost all companies to eventually be founded and run by AIs rather than humans?

I find that people give a number of different answers:

Possible Answer 1: “No, because the best humans will always be better than large language models (LLMs) at founding and running companies.”

Huh? Whoever said anything about LLMs? I wrote “AIs”!

As it happens, I do think that humans will always be better than LLMs at founding and running companies! But if [...]

---

Outline:

(01:07) Conversation-starting question: Do you expect almost all companies to eventually be founded and run by AIs rather than humans?

(01:18) Possible Answer 1: "No, because the best humans will always be better than large language models (LLMs) at founding and running companies."

(01:58) Possible Answer 2: "No, because the best humans will always be better than AIs at founding and running companies."

(03:35) Possible Answer 3: "No, because humans will always be equally good as AIs at founding and running companies."

(07:14) Possible Answer 4: "No, because we will pass laws preventing AIs from founding and running companies."

(07:48) Possible Answer 5: "No, because if someone wants to start a business, they would prefer to remain in charge themselves, and ask an AI for advice when needed, rather than 'pressing go' on an autonomous entrepreneurial AI."

(13:11) Possible Answers 6 & 7: "No, because we will eternally globally ban further AI research and progress before it reaches a point where AI could be a competent CEO" -OR- "No, because after the AIs exterminate (or permanently disempower) humanity, they will not operate via 'companies' as we think of them today."

(13:57) Afterword

The original text contained 6 footnotes which were omitted from this narration.

---

First published:
July 22nd, 2026

Source:
https://www.lesswrong.com/posts/BHEcssYwYrzTBf9Qm/will-almost-all-future-companies-eventually-be-founded-and

---

Narrated by TYPE III AUDIO.

---

Images from the article:

A scale from Easy to Hard comparing AI control difficulty with tasks.

More details at: What do I mean by “Artificial General Intelligence”?

I notice the image contains a tweet, but I also see there are conflicting instructions here. The first instruction tells me to only respond

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

“Will almost all future companies eventually be founded and run by autonomous AIs?” by Steven Byrnes

LessWrong (30+ Karma)

“Will almost all future companies eventually be founded and run by autonomous AIs?” by Steven Byrnes