Emergency Pod: OpenAI's new Functions API, 75% Price Drop, 4x Context Length (w/ Alex Volkov, Simon Willison, Riley Goodside, Joshua Lochner, Stefania Druga, Eric Elliott, Mayo Oshin et al)
This podcast episode covers various topics related to large language models (LLMs), including the OpenAI June Update, functions release for ChatGPT, the functions API for LLMs, the role of LLMs in API design, prompt engineering, price reductions for API access to LLMs, selection of functions in OpenAI's API, integration of functions and retrieval systems in language models, GPT 3.5, the debate between LLM Core and Code Shell paradigms, the transition from prompt engineering to direct tooling, the evolving capabilities of language models, challenges with prompt injection, system design considerations for LLM usage, and the potential of JSONformer and ChatGPT in structured data generation.
