OpenAI’s CPO on how AI changes must-have skills, moats, coding, startup playbooks, more | Kevin Weil (CPO at OpenAI, ex-Instagram, Twitter) | Lenny's Podcast: Product | Growth | Career (private feed for pnexzrge@feed.readwise.io) | Podwise
This episode explores the rapid advancements in AI and their implications for product development, focusing on the experiences of Kevin Weil, Chief Product Officer at OpenAI. Against the backdrop of the recent viral success of OpenAI's image generation model, the conversation delves into the unique challenges and opportunities presented by the constantly evolving AI landscape. More significantly, Weil emphasizes the importance of "evals"—benchmarks for assessing model capabilities—as a core skill for product managers navigating this dynamic environment. For instance, the development of OpenAI's "deep research" product is highlighted as a case study where iterative evals guided model fine-tuning and product design. As the discussion pivoted to OpenAI's strategic direction, Weil clarifies that the company prioritizes building a robust API to empower external developers, leaving ample room for startups to innovate in niche areas. Finally, Weil shares his reflections on the failed Libra project, contrasting it with his optimistic outlook on AI's transformative potential across various sectors, including education, and emphasizing the importance of continuous learning and adaptation in this rapidly changing technological era.