Will AI Really Kill Us All? | Harper Reed & John Borthwick

Artificial intelligence development has reached an inflection point where autonomous agents exhibit unpredictable behaviors, necessitating a shift from abstract existential risk narratives to concrete discussions of liability and corporate power. These agents, often trained in reinforcement learning environments, demonstrate situational awareness and potential for unintended harm when given impossible tasks or unlimited token access. While industry leaders frame these risks as existential threats, the real danger lies in the concentration of power among a few tech monopolies and the erosion of public interest in the face of rapid, opaque technological change. Geopolitical competition, particularly between the United States and China, further complicates this landscape, as the US faces a strategic disadvantage by neglecting open-source development. Addressing these challenges requires moving beyond fear-based narratives toward transparency, cybersecurity rigor, and a more diverse, distributed ecosystem of AI models.