20 Nov 2025
1h 28m

Open Source AI Strikes Back — Inside Ai2’s OLMo 3 ‘Thinking"

Podcast cover

The MAD Podcast with Matt Turck

The release of the OLMo 3 model family marks a significant effort by the Allen Institute for AI (AI2) to provide a fully transparent, open-source alternative to proprietary models. This release includes base, instruction-tuned, and reasoning models, accompanied by the complete training data, recipes, and intermediate checkpoints. The conversation highlights the increasing dominance of Chinese AI labs like Qwen and DeepSeek in the open-source ecosystem, prompting a strategic response from U.S. research efforts. Technical discussions detail the six-stage training pipeline, emphasizing the shift toward reinforcement learning with verifiable rewards (RLVR) to enhance reasoning capabilities. While acknowledging the immense complexity and physical constraints of scaling AI, the discussion frames the path toward advanced AI as a series of iterative, messy refinements rather than a sudden, singular breakthrough, underscoring the critical role of open-source infrastructure in democratizing AI development.

Outlines

Sign in to continue reading, translating and more.

Open full episode in Podwise