22 Mar 2023
1h 2m

Chelsea Finn: how to build AI that can keep up with an always changing world

Podcast cover

The Robot Brains Podcast

Artificial intelligence and robotics face significant hurdles in real-world deployment due to distribution shift, where systems fail to generalize when encountering data different from their training sets. Addressing this requires moving beyond static models toward techniques like targeted model editing, which allows for rapid updates without full retraining, and "single-life" reinforcement learning, which enables robots to learn autonomously during a single episode. Current robotics research remains constrained by fragmented, small-scale datasets, necessitating a transition toward large-scale, open-source data collection across diverse environments. Furthermore, the field must evolve away from reliance on rigid, often unrealistic reward functions, favoring more natural methods for goal specification. Chelsea Finn, a professor at Stanford, highlights these challenges, emphasizing that building robust, adaptive systems requires rethinking the standard train-test paradigm and prioritizing long-term, cumulative learning over isolated, task-specific training cycles.

Outlines

Sign in to continue reading, translating and more.

Open full episode in Podwise