@Scale: AI & Data 2025

This podcast transcript captures the "AI at Scale" event, featuring multiple speakers and panel discussions centered on the evolution, challenges, and future of AI, particularly concerning AI agents and infrastructure. Speakers from Meta, Snowflake, NVIDIA, and other companies discuss topics such as scaling AI, data access, security, observability, and the role of humans in an increasingly agentic world. The discussions cover technical challenges, emerging trends, and predictions for the future of AI, including the need for reliable AI systems, the importance of data context, and the shift towards autonomous agents.

Outlines

Part 1: Conference Introduction

Part 2: AI Trends and Challenges

Part 3: MetaMate Evolution and Use Cases

Part 4: Structured Data for AI Agents

Part 5: Agent Evaluation and Autonomous Systems

Part 6: Silent Data Corruptions in GPUs

Part 7: Q&A Session

Part 8: Closing and Thank You

Part 9: Panel Introductions and Concluding Remarks

Sign in to continue reading, translating and more.

Open full episode in Podwise

@Scale

Part 1: Conference Introduction

00:25Introduction to At Scale AI and Data 2025

Introduction to At Scale AI and Data 2025

Part 2: AI Trends and Challenges

16:38AI and Data at Scale: Key Trends and Challenges

AI and Data at Scale: Key Trends and Challenges

34:22Fireside Chat: Jan Stojka on Problem Solving and the Future of AI

Fireside Chat: Jan Stojka on Problem Solving and the Future of AI

57:07Jan Stojka's Predictions for the Future of AI

Jan Stojka's Predictions for the Future of AI

Part 3: MetaMate Evolution and Use Cases

1:02:05MetaMate: From Chatbot to AI Co-worker

MetaMate: From Chatbot to AI Co-worker

1:14:45MetaMate Use Cases and Future Development

MetaMate Use Cases and Future Development

Part 4: Structured Data for AI Agents

1:20:09Structured Data Context for AI Agents in the Enterprise

Structured Data Context for AI Agents in the Enterprise

1:34:43Snowflake's Approach to Generating High-Quality SQL for AI Agents

Snowflake's Approach to Generating High-Quality SQL for AI Agents

Part 5: Agent Evaluation and Autonomous Systems

1:39:42Evaluating Agents and the LLAMA Stack

Evaluating Agents and the LLAMA Stack

1:52:31Personal Learnings and the Future of Autonomous Agents

Personal Learnings and the Future of Autonomous Agents

Part 6: Silent Data Corruptions in GPUs

1:59:43Addressing Silent Data Corruptions in GPUs

Addressing Silent Data Corruptions in GPUs

2:03:30The Journey of an SDC from Silicon to Software

The Journey of an SDC from Silicon to Software

2:10:07NVIDIA's Multi-Tiered Strategy for Mitigating SDCs

NVIDIA's Multi-Tiered Strategy for Mitigating SDCs

2:18:17The Virtuous Cycle of GPU Improvement

The Virtuous Cycle of GPU Improvement

Part 7: Q&A Session

2:20:07Q&A: MetaMate Privacy and Compliance

Q&A: MetaMate Privacy and Compliance

2:22:16Q&A: Hallucinations and Context

Q&A: Hallucinations and Context

2:24:22Q&A: LLAMA Stack and Open Challenges

Q&A: LLAMA Stack and Open Challenges

2:30:02Q&A: Silent Data Corruptions

Q&A: Silent Data Corruptions

2:33:00Q&A: MetaMate Metrics

Q&A: MetaMate Metrics

2:35:57Q&A: Microservices and MDO

Q&A: Microservices and MDO

2:42:24Q&A: Reinforcement Learning

Q&A: Reinforcement Learning

2:47:10Q&A: Enterprise Preparation

Q&A: Enterprise Preparation

2:50:02Q&A: Evaluation

Q&A: Evaluation

2:53:36Q&A: Traditional Analytics

Q&A: Traditional Analytics

2:57:31Q&A: Five Years From Now

Q&A: Five Years From Now

Part 8: Closing and Thank You

3:00:54Closing Remarks

Closing Remarks

3:02:52Music Interlude

Music Interlude

3:04:19Thank You

Thank You

3:06:01.

.

3:12:35Thank You

Thank You

3:13:00.

.

3:14:11Thank you for watching

Thank you for watching

3:15:51You Thank you

You Thank you

3:16:23.

.

3:19:18Thank you for watching

Thank you for watching