The Collaboration that Built Modern AI

The conversation explores the evolution and future of AI through the experiences and insights of AI pioneers Geoffrey Hinton and Jeff Dean. It traces the journey from early neural network research to the development of groundbreaking models like AlexNet and Gemini, highlighting the increasing importance of compute power and data. Hinton and Dean reflect on key moments, such as the realization of compute's significance, the creation of Google Brain, and the transformative potential of Transformers. They also touch upon the ethical and societal implications of AI, including job displacement and the need for wealth redistribution, while expressing optimism about AI's potential to accelerate scientific discovery and revolutionize healthcare and education.

Outlines

Part 1: Origins, Scaling, and Early Breakthroughs

Part 2: Google Brain, Acquisitions, and Early Culture

Part 3: Transformers, Chatbots, and Strategic Shifts

Part 4: Hardware Innovation and Co-Design

Part 5: Future Outlook and Societal Impact

Sign in to continue reading, translating and more.

Open full episode in Podwise

Radical Talks

Part 1: Origins, Scaling, and Early Breakthroughs

Radical Talks: A Conversation with AI Pioneers Jeff Dean and Geoffrey Hinton

Early Computing Experiences: Parallel Algorithms and the Importance of Scaling

Identifying Original Thinkers and the Genesis of AlexNet

The Origins of Google Brain and the Scaling Laws of AI

Part 2: Google Brain, Acquisitions, and Early Culture

Hinton's Internship at Google and the Acquisition of DNN Research

The Early Days of Google Brain and the Cautionary Tale of BlackBerry

Part 3: Transformers, Chatbots, and Strategic Shifts

The Development of Transformers and the Power of Parallel Computation

Google's Internal Chatbot and the Cautious Approach to Public Release

The "Code Red" Reaction to ChatGPT and the Birth of Gemini

Part 4: Hardware Innovation and Co-Design

The Origins of TPUs and Google's Competitive Advantage

Co-Designing Hardware and Software for Machine Learning

Part 5: Future Outlook and Societal Impact

The Future Impact of AI: Healthcare, Education, and Scientific Breakthroughs

The Collaboration that Built Modern AI

Radical Talks

Part 1: Origins, Scaling, and Early Breakthroughs

00:05Radical Talks: A Conversation with AI Pioneers Jeff Dean and Geoffrey Hinton

Radical Talks: A Conversation with AI Pioneers Jeff Dean and Geoffrey Hinton

03:26Early Computing Experiences: Parallel Algorithms and the Importance of Scaling

Early Computing Experiences: Parallel Algorithms and the Importance of Scaling

06:48Identifying Original Thinkers and the Genesis of AlexNet

Identifying Original Thinkers and the Genesis of AlexNet

12:13The Origins of Google Brain and the Scaling Laws of AI

The Origins of Google Brain and the Scaling Laws of AI

Part 2: Google Brain, Acquisitions, and Early Culture

16:11Hinton's Internship at Google and the Acquisition of DNN Research

Hinton's Internship at Google and the Acquisition of DNN Research

21:22The Early Days of Google Brain and the Cautionary Tale of BlackBerry

The Early Days of Google Brain and the Cautionary Tale of BlackBerry

Part 3: Transformers, Chatbots, and Strategic Shifts

26:08The Development of Transformers and the Power of Parallel Computation

The Development of Transformers and the Power of Parallel Computation

30:23Google's Internal Chatbot and the Cautious Approach to Public Release

Google's Internal Chatbot and the Cautious Approach to Public Release

35:43The "Code Red" Reaction to ChatGPT and the Birth of Gemini

The "Code Red" Reaction to ChatGPT and the Birth of Gemini

Part 4: Hardware Innovation and Co-Design

40:06The Origins of TPUs and Google's Competitive Advantage

The Origins of TPUs and Google's Competitive Advantage

45:07Co-Designing Hardware and Software for Machine Learning

Co-Designing Hardware and Software for Machine Learning

Part 5: Future Outlook and Societal Impact

49:59The Future Impact of AI: Healthcare, Education, and Scientific Breakthroughs

The Future Impact of AI: Healthcare, Education, and Scientific Breakthroughs