This episode explores the future of AI agents and their integration into various applications. Against the backdrop of OpenAI's recent releases, the discussion centers on how consumers will interact with agents in the next 5-10 years, envisioning their embedding into everyday products and services like web browsers and work tools. More significantly, the conversation delves into the development of these agents, highlighting the shift from deterministic workflows to chain-of-thought reasoning and the increasing use of multiple tools in parallel. For instance, the guests discuss the creation of an API-designing agent and the challenges of evaluating agents in highly specialized domains like healthcare and law. The discussion also touches upon the role of companies in actively building for this agentic future, emphasizing the importance of internal agent development and the potential for exposing these agents to the public internet. In contrast to the initial focus on clearly defined workflows, the conversation highlights the move towards more flexible and adaptable agent architectures, enabled by advancements in reinforcement fine-tuning. What this means for developers is a need to focus on agent orchestration and tool integration, rather than solely relying on prompt engineering, as the models themselves become increasingly powerful.