Most people know AI as the technology behind chatbots like ChatGPT. However, what the top AI companies are explicitly aiming for is something else entirely: superintelligent AI. That means AI that can fully replace and outmatch humans at any task, including in domains like hacking, social engineering, and military operations. Such an AI system, if developed, could autonomously overpower any country's national security forces.

No company, no government, no individual knows how to keep such a system under human control. This is why the world's leading AI experts, Nobel Prize winners, and even the CEOs of the top AI companies warn that the development of superintelligence threatens humanity with extinction, and why more than 800 scientists, former military leaders, and public figures have called for a prohibition on developing superintelligence.

This is not a distant prospect: AI companies such as OpenAI and Anthropic are investing billions of dollars into superintelligence and aiming to develop it within the next few years. Former Anthropic and OpenAI researcher Jacob Coxon, who resigned last week, stated that AI companies are “racing straight to self-improving superintelligence and gambling with our lives” and that people at the companies themselves believe it “could kill [...]

---

Outline:

(04:34) Secure Weapons-Grade AI Against Theft by Adversaries

(07:46) Necessary Measure: Registration

(08:43) Sufficient Measure: Government Security Testing

(09:42) Thorough Measure: Development Requires Government Authorization

(10:52) Criminal Liability for Leaks During AI Gain-of-Function Research

(14:09) Necessary Measure: Team Liability

(14:46) Sufficient Measure: Chain of Command Liability

(15:21) Thorough Measure: Company Liability

(16:00) Kill-Switches to Contain Critical AI Incidents

(19:08) Necessary Measure: Company Kill-Switch

(19:58) Sufficient Measure: Infrastructure Kill-Switch

(20:53) Thorough Measure: International Kill-Switches

(22:24) Conclusion

---

First published:
September 18th, 2026

Source:
https://www.lesswrong.com/posts/LqBAxFdyAiybnPL8e/stopgap-measures-to-address-immediate-ai-security-threats

---

Narrated by TYPE III AUDIO.

“Stopgap Measures to Address Immediate AI Security Threats” by Andrea_Miotti, Gabriel Alfour

LessWrong (30+ Karma)

“Stopgap Measures to Address Immediate AI Security Threats” by Andrea_Miotti, Gabriel Alfour