Illia Polosukhin: Fixing the Broken System He Helped Create

In this episode of The Neuron, Corey Noles and Grant Harvey interview Illia Polosukhin, co-author of the "Attention is All You Need" paper, about the evolution and future of AI. Illia discusses the initial expectations versus the actual progress of AI since 2017, the limitations of current scaling laws, and the need for better training mechanisms and context integration. He introduces the concept of decentralized confidential machine learning through the NEAR Protocol, aiming to create user-owned AI that ensures privacy, data ownership, and fair monetization for creators. The conversation explores how blockchain technology can facilitate autonomous AI agents, enable secure data handling, and revolutionize various sectors by fostering a peer-to-peer network where AI represents individual interests.