26 Nov 2025
1h 5m

What’s Next for AI? OpenAI’s Łukasz Kaiser (Transformer Co-Author)

Podcast cover

The MAD Podcast with Matt Turck

In The MAD Podcast, Matt Turck interviews Lukasz Kaiser, a key figure in modern AI and one of the inventors of the transformer architecture. They discuss the exponential progress of AI, the shift towards reasoning models, and the misconception that AI development is slowing down. Lukasz explains that while pre-training is still valuable, the new paradigm of reasoning models offers more significant gains for the same investment. He highlights the importance of reinforcement learning in training these models and addresses the challenges and opportunities in multimodal AI. The conversation also covers Lukasz's journey into AI research, the story behind the Transformer paper, the differences between research cultures at Google and OpenAI, and the future of pre-training and generalization in AI. They delve into the specifics of GPT-5.1, the role of post-training, and the balance between model capabilities and real-world applications, including the potential for AI in robotics and the evolving job market.

Outlines

Part 1: AI Growth and Reasoning Models

Part 2: Improving AI Models

Part 3: Lukasz Kaiser's Journey

Part 4: Pre-training and Interpretability

Part 5: GPT-5.1 Deep Dive

Part 6: Generalization and Architecture

Part 7: Future and Conclusion

Sign in to continue reading, translating and more.

Open full episode in Podwise