Highlights

00:03 — Microsoft AI CEO Mustafa Suleyman has published a blog post that criticizes the notion of seemingly conscious AI. He argues that the pursuit of this idea, particularly regarding AI model welfare, is misguided.

00:19 — Suleyman explains that these concepts are already causing mental health issues among users. He is growing: “more and more concerned about what is becoming known as the psychosis risk and a bunch of related issues. I don’t think this will be limited to those who are already at risk of mental health issues.”

00:56 — Suleyman argues that we should “build AI for people not to be a person.” He is adamant in his neglect of this previous approach, saying that: “The arrival of seemingly conscious AI is inevitable and unwelcome. Instead, we need a vision for AI that can fulfill its potential as a helpful companion without falling prey to its illusions.”

AI Agent & Copilot Summit is an AI-first event to define opportunities, impact, and outcomes with Microsoft Copilot and agents. Building on its 2025 success, the 2026 event takes place March 17-19 in San Diego. Get more details.

01:18 — Meanwhile, companies like Anthropic, OpenAI, and Google DeepMind are actively pursuing AI consciousness or welfare research. Now, while there are complications and not everyone is on the same page, here, it is clear that the evolving scenarios and possibilities presented by AI are increasingly reaching into the realm of the surreal and in some cases, they’re fantastical.

01:42 — This is largely because, for the first time in human history, we have a tool that is evolving at a pace beyond which we can conceive. While some of these ideas may sound far-fetched, the warnings accompanying them are serious based on real concerns coming from leaders in the AI space, the ones leading this new AI revolution.

02:04 — What everyone must do, and though it will be challenging, is to start imagining the unimaginable. Once you accept the vast possibilities of AI, both good and bad, you can begin to take the warnings that come with them seriously.

Visit Cloud Wars for more.

Microsoft’s Mustafa Suleyman Warns Against the Illusion of Conscious AI: “Build AI for People, Not to Be a Person”

Cloud Wars Live with Bob Evans