Talks - Yury Selivanov: Overcoming GIL with subinterpreters and immutability

From the creator

The talk will focus on a novel idea of efficient structured data sharing between Python subinterpreters. I'll be presenting a new Python framework "memhive", which implements a worker pool of subinterpreters, efficient RPC mechanism between them, async/await-ready API, as well as fundamental data structures ( tuples, mappings and scalar types). I'll demonstrate that it's possible to unlock true parallelism with subinterpreters without paying the overhead of data serialization. I'll explain how this is possible and what algorithms under the hood drive this. Slides: https://pycon-assets.s3.amazonaws.com/2024/media/presentation_slides/67/2024-05-18T03%3A28%3A48.709949/subint.pdf

Published 2024-08-28 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.