This podcast episode discusses the development and optimization of Dynamo, a tool for tracing and optimizing PyTorch programs, through the lens of its variable tracker implementation. Notable changes to the variable tracker include eliminating the need for guard propagation, introducing Mutable Variable Trackers for improved performance, and simplifying checkpointing mechanisms. Dynamo's variable trackers are organized based on logical chunks of C code simulated, with special handling of state changes in large variable classes.
Sign in to continue reading, translating and more.
Continue
