KEYNOTE: The Distributed PostgreSQL Problem & How Citus Solves it | Citus Con 2023

From the creator

In this keynote talk by Marco Slot at Citus Con: An Event for Postgres 2023, Marco explores the distributed PostgreSQL problem and how Citus solves it. Building distributed PostgreSQL is perhaps one of the most challenging software engineering projects imaginable. Early on, the Citus team decided to architect Citus as PostgreSQL extension. That way Citus remains part of the PostgreSQL ecosystem even as PostgreSQL keeps developing. Moreover, architecting Citus as an extension made distribution a feature that can simply be added to PostgreSQL without losing the versatile feature set of Postgres, nor its mature, efficient implementations. The goal of Citus is to provide high PostgreSQL performance at any scale, but simply distributing data across machines is rarely sufficient to achieve that. Crisp distribution concepts and careful trade-offs are important to favor workload patterns that benefit from scaling out. There are also many complex engineering problems given the large PostgreSQL feature set, failures and concurrency in distributed systems, and mission-critical nature of databases. Marco discusses the main engineering challenges faced over the past 10 years of developing the fastest, most mature, open-source Distributed PostgreSQL implementation: Citus. Marco Slot is a Principal Software Engineer at Microsoft and is Lead Architect of the Citus team. He has been working on PostgreSQL extensions including Citus and pg_cron since 2014 when he first joined Citus Data,

Published 2023-05-08 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.