Al Engineering 101 with Chip Huyen (Nvidia, Stanford, Netflix)

In this episode of Lenny's Podcast, Chip Huyen, an AI expert, discusses key aspects of building successful AI applications. She highlights the importance of talking to users, preparing better data, and optimizing workflows over simply chasing the latest AI news or technologies. Chip clarifies the differences between pre-training and post-training, including fine-tuning, and delves into reinforcement learning with human feedback (RLHF). She also addresses the economics of data labeling companies, the role and importance of evals, and the concept of Retrieval Augmented Generation (RAG). Chip shares insights from her work with various companies, discussing AI tool adoption, measuring productivity, and the evolving roles of engineers in the age of AI, and offers her predictions for the future of AI, including organizational restructuring, the shift towards post-training improvements, and the rise of multimodal applications.