It’s human to know oneself. We are able to self-monitor, understand our cognition, and recognize gaps in our knowledge. This is called metacognition—we think about how we think. We can think of it as self-awareness or the ability to understand the state of our knowledge. In this episode, we talk with Stephen Fleming, Professor of Cognitive Neuroscience at University College London.

Steve has recently published a book on this topic called Know Thyself. We wanted to explore a number of ideas with him—metacognition as uniquely human, as an important skill, whether machines need to have some form of awareness and the issue of agency and machines.

In his book, Steve proposes that we either put self-awareness into machines, thereby reducing our need for self-awareness, or design interfaces that increase human self-awareness. If we have self-aware machines then we risk losing our own. If we want better self-awareness we must prioritize how an AI metacognition can show us its uncertainty and error. This second route is more likely to result in humans retaining autonomy. It preserves the human role of wrestling uncertainty, seeking explanations, and making sense of the world. Perhaps the biggest insight for us regarding agency and AI is how to think about it as having a structure. We talk about how true autonomy is aligning our choices and wants and how machines play a role.

About Artficiality from Helen & Dave Edwards:

Artificiality is a research and services business founded in 2019 to help people make sense of artificial intelligence and complex change. Our weekly publication provides thought-provoking ideas, science reviews, and market research and our monthly research releases provides leaders with actionable intelligence and insights for applying AI in their organizations. We provide research-based and expert-led AI strategy and complex change management services to organizations around the world.

We are artificial philosophers and meta-researchers who aim to make the philosophical more practical and the practical more philosophical. We believe that understanding AI requires synthesizing research across disciplines: behavioral economics, cognitive science, complexity science, computer science, decision science, design, neuroscience, philosophy, and psychology. We are dedicated to unraveling the profound impact of AI on our society, communities, workplaces, and personal lives.

Subscribe for free at https://www.artificiality.world.

If you enjoy our podcasts, please subscribe and leave a positive rating or comment. Sharing your positive feedback helps us reach more people and connect them with the world’s great minds.

Learn more about ⁠⁠Sonder Studio⁠⁠

Subscribe to get ⁠⁠Artificiality⁠⁠ delivered to your email

Learn about our book ⁠⁠Make Better Decisions⁠⁠ and buy it on ⁠⁠Amazon⁠⁠

Thanks to ⁠⁠Jonathan Coulton⁠⁠ for our music

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.artificiality.world.

#ai #artificialintelligence #generativeai #airesearch #complexity #futureofai

Stephen Fleming: Metacognition

Stay Human, from the Artificiality Institute