Pierre-Carl Langlais (aka Alexandar Doria) is Co-founder of Pleias. We'd discussed about pre-training recipes, common corpus, mid-training, agentic systems, good post-training and everything AI.

TIMESTAMPS

00:00:00 - TEASER

00:01:12 - INTRO

00:02:03 - Who is Alexander Doria [Pierre-Carl Langlais]?

00:04:10 - Early career: From humanities to AI research

00:07:50 - Meeting influential people in computational humanities

00:10:00 - How the idea of Pleias came about

00:13:30 - Building Pleias: Infrastructure and compute challenges in Europe

00:17:06 - Team structure and work culture at Pleias

00:19:06 - What is "open science" and why it matters

00:21:53 - Big announcement: OpenSynthetic initiative

00:25:25 - Synthetic data experiments and surprising results

00:28:11 - "The Model is the Product" - explained

00:31:56 - Implications for companies building on top of models

00:35:25 - Differentiation in a world of shared base models

00:38:40 - Common Corpus: Origins and development

00:44:12 - The lack of open, legally clear datasets

00:47:03 - Anthropic's use of Common Corpus for mechanistic interpretability

00:50:20 - What makes good post-training?

00:54:00 - Reasoning under 400M parameters in SLMs

00:56:35 - Generalist scaling is stalling - where are the diminishing returns?

00:59:40 - Will specialization always win over scale?

01:02:00 - Opinionated and task-specialized models

01:06:29 - How inference cost drops change monetization models

01:09:12 - New value layers beyond token marketplaces

01:11:38 - Major technical obstacles to embedding workflows in models

01:13:40 - How smaller labs can compete on training infrastructure

01:15:36 - Should startups raise capital for AI training?

01:17:16 - What new capabilities do models need for orchestration?

01:19:50 - Designing verifier functions for agentic models

01:22:17 - RL in domains with weak or delayed rewards

01:24:50 - Multi-step training loops: Draft, verify, refine, backtrack

01:26:38 - The scarcity of agentic data and bootstrapping solutions

01:29:32 - Making agent training tractable at scale

01:31:44 - What is mid-training and why it matters

01:34:55 - Deployment, use cases, and hybrid model architectures

01:37:37 - Human-in-the-loop for regulated domains

01:39:48 - Advice for startups positioning in this transition

01:41:58 - Europe's structural challenges in AI

01:45:52 - Tokenizers: The overlooked competitive frontier

01:49:59 - Training LLMs on personal data and dead languages

01:52:12 - World models and JEPA architectures

01:53:50 - Building agentic systems: Stack and RL environments

01:55:34 - The art of training good RL models

01:58:49 - Trivia: Underrated habits and mindsets in research

02:00:09 - AI Twitter community and its impact

02:01:40 - Advice for folks starting in AI research

02:03:27 - Final thoughts and wrap-up

Model is the Product | Common Corpus, Mid-Training, Open Science | Pierre-Carl Langlais, Pleias

GroundZero AI Talks

Model is the Product | Common Corpus, Mid-Training, Open Science | Pierre-Carl Langlais, Pleias