17:57Building a Real-Time Analytics Database • Tim Berglund • GOTO 2023
From the creator
This presentation was recorded at GOTO Chicago 2023. #GOTOcon #GOTOchgo https://gotochgo.com Tim Berglund - VP DevRel at StarTree & Author of "Gradle Beyond the Basics" @tlberglund@StarTree ORIGINAL TALK TITLE Building a Real-Time Analytics Database: A 'Choose Your Own Adventure' Journey RESOURCES https://pinot.apache.org https://twitter.com/startreedata https://www.linkedin.com/company/startreedata https://dev.startree.ai https://stree.ai/slack Tim http://timberglund.com https://twitter.com/tlberglund https://www.linkedin.com/in/tlberglund ABSTRACT Have you ever stopped to think about how to build a database? The thing is, there isn't just one way, as we can see by the massive number of data infrastructure options we have to choose from. It's a nonstop series of tradeoffs, each motivated by the constraints the database wants to satisfy. An in-memory transactional database would be one thing. A general-purpose, single-server relational database would be another. A low-latency, horizontally scalable analytics database would be...the journey we're going to take. In this talk, we'll start by picking a data model, make decisions about serialization and storage, choose indexing strategies, pick a query language, and figure out how to scale, eventually ending up with something that looks remarkably like Apache Pinot, a real-time analytics database. Pinot was built on a journey like this, always optimized for ultra low-latency, user-facing analytics at scale. In the real wor
Published 2023-07-28 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.





