tubeshowcase●1,672,868 videos♡ My collection 0
← Learn to Code

Learn to Code32:28

Orchestrating Your Data Pipelines with Apache Airflow • Ricardo Sueiras • GOTO 2022

GOTO Conferences ↗

From the creator

This presentation was recorded at GOTO Amsterdam 2022. #GOTOcon #GOTOams http://gotoams.nl Ricardo Sueiras - Principal Advocate in Open Source at AWS & Experienced Coach & Mentor @ricardoasueiras RESOURCES GitHub Repo: https://github.com/094459/building-data-pipelines-apache-airflow https://airflow.apache.org ABSTRACT Apache Airflow continues to gain adoption for its ability to configure data pipelines as scripts, monitor them with a great user interface, and extend their functionality through a set of community-developed and custom plugins. In this session, Ricardo will introduce Apache Airflow and its key components and then dive into building some simple pipelines exploring these and so you can begin to get an idea of how you can use Apache Airflow to orchestrate your own data pipelines. [...] TIMECODES 00:00 Intro 01:10 What is in your data pipeline? 02:33 Introducing Apache Airflow 12:11 Demo 18:13 Building our data pipeline demo 20:23 Demo 30:52 Apache Airflow evolution 31:48 How to contribute 32:10 Outro Read the full abstract here: https://gotoams.nl/2022/sessions/2014/orchestrating-your-data-pipelines-with-apache-airflow RECOMMENDED BOOKS Bas P. Harenslak & Julian Rutger de Ruiter • Data Pipelines with Apache Airflow • https://amzn.to/3HlM0LC Danil Zburivsky & Lynda Partner • Designing Cloud Data Platforms • https://amzn.to/3Rgr6lD Gareth Eagar • Data Engineering with AWS • https://amzn.to/3DqiGCN Martin Kleppmann • Designing Data-Intensive Applications • htt

Published 2023-02-01 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.

Keep exploring Learn to Code