This is a linkpost for https://titotal.substack.com/p/the-leeroy-jenkins-principle-how

Confidence level: This is all speculation about tech that doesn’t exist yet. Everything is highly uncertain. All “simulations” within are illustrative models and should not be taken as serious predictions.

When talking about AI, existential risk theorists almost always focus their attention on the best of the best AGI. Even if some AI along the way is mediocre, or a buggy mess, or mostly correct but wildly off in some areas, it's not ultimately important, compared to the one critical try, when the best, near flawless superintelligence hits the point where they can reliably defeat humanity in one go.

But there is one area where every level matters, especially AI that is flawed, badly trained, or idiotic. And that is the area of attacks that fail, otherwise known as “warning shots”.

It is far easier to conceive of a plan to destroy humanity, than [...]

---

Outline:

(02:06) Part 1: why some AGI will be faulty

(10:11) Part two: Faulty AI and the Leeroy Jenkins principle

(32:25) Part 3: Conclusions:

---

First published:
January 14th, 2024

Source:
https://www.lesswrong.com/posts/LZQm7osgjh5tBbEfF/the-leeroy-jenkins-principle-how-faulty-ai-could-guarantee

Linkpost URL:
https://titotal.substack.com/p/the-leeroy-jenkins-principle-how

---

Narrated by TYPE III AUDIO.

[Linkpost] “The Leeroy Jenkins principle: How faulty AI could guarantee ‘warning shots’” by titotal

LessWrong (30+ Karma)