#447: Parallel Python Apps with Sub Interpreters

This podcast episode discusses the evolution of Python's performance, especially with the introduction of subinterpreters. Subinterpreters allow for parallel execution of code, improving performance and efficiency. The episode highlights the benefits and challenges of using subinterpreters, including data exchange, memory isolation, and compatibility with C extensions. The experts share their experiences working on Python's performance team and provide insights into the future of subinterpreters, including upcoming API changes and integration with other Python advancements. Overall, the episode reinforces the potential of subinterpreters to enhance Python's concurrency and performance capabilities.

Outlines

Sign in to continue reading, translating and more.

Continue

Talk Python To Me

Sub-interpreters: A New Era of Python Isolation and Parallelization

Python's Performance and Subinterpreters: An Exciting Journey

Sub-interpreters and Free-threading in Python 3.12

GIL per interpreter: Memory isolation and stability

Subinterpreters: A New Way to Manage Python Concurrency

Data Exchange in Sub Interpreters: Pickle and DIL

Sub-Interpreters: Data Sharing and Immutable Types

Subinterpreters: A Parallel Programming Paradigm in Python

Subinterpreters in Python 3.12: A New Way to Run Parallel Web Apps

Creating and Running Python Sub Interpreters

Sub-Interpreter Shutdown and Communication

Running Pytest Sessions in Sub Interpreters: Exploring C Extension Compatibility

PEP 734: The Future of Sub Interpreters in Python

How to Check if Your Python Code is Running in a Subinterpreter

#447: Parallel Python Apps with Sub Interpreters

Talk Python To Me

00:00Sub-interpreters: A New Era of Python Isolation and Parallelization

Sub-interpreters: A New Era of Python Isolation and Parallelization

03:56Python's Performance and Subinterpreters: An Exciting Journey

Python's Performance and Subinterpreters: An Exciting Journey

09:31Sub-interpreters and Free-threading in Python 3.12

Sub-interpreters and Free-threading in Python 3.12

16:00GIL per interpreter: Memory isolation and stability

GIL per interpreter: Memory isolation and stability

21:45Subinterpreters: A New Way to Manage Python Concurrency

Subinterpreters: A New Way to Manage Python Concurrency

26:29Data Exchange in Sub Interpreters: Pickle and DIL

Data Exchange in Sub Interpreters: Pickle and DIL

30:37Sub-Interpreters: Data Sharing and Immutable Types

Sub-Interpreters: Data Sharing and Immutable Types

34:26Subinterpreters: A Parallel Programming Paradigm in Python

Subinterpreters: A Parallel Programming Paradigm in Python

40:08Subinterpreters in Python 3.12: A New Way to Run Parallel Web Apps

Subinterpreters in Python 3.12: A New Way to Run Parallel Web Apps

46:42Creating and Running Python Sub Interpreters

Creating and Running Python Sub Interpreters

50:22Sub-Interpreter Shutdown and Communication

Sub-Interpreter Shutdown and Communication

55:57Running Pytest Sessions in Sub Interpreters: Exploring C Extension Compatibility

Running Pytest Sessions in Sub Interpreters: Exploring C Extension Compatibility

1:02:01PEP 734: The Future of Sub Interpreters in Python

PEP 734: The Future of Sub Interpreters in Python

1:07:06How to Check if Your Python Code is Running in a Subinterpreter

How to Check if Your Python Code is Running in a Subinterpreter