tubeshowcase●1,671,863 videos♡ My collection 0
← Learn to Code

Learn to Code10:59

Siphon on HDInsight Kafka | Azure Friday

Microsoft Developer ↗

From the creator

Thomas Alex joins Lara Rubbelke to discuss how Microsoft uses Apache Kafka for HDInsight to power Siphon, a data ingestion service for internal use. Apache Kafka for HDInsight is an enterprise-grade, open-source, streaming ingestion service. Microsoft created Siphon as a highly available and reliable service to ingest massive amounts of data for processing in near real time. Siphon handles ingestion of over a trillion events per day across multiple business-critical scenarios at Microsoft. In this episode, learn how Siphon uses Apache Kafka for HDInsight as its scalable pub/sub message queue. [01:50] Demo Start For more information: + Quickstart: Create a Kafka on HDInsight cluster https://aka.ms/azfr/461/01 + Tutorial: Use Spark Structured Streaming with Kafka on HDInsight https://aka.ms/azfr/461/02 + Apache Kafka for HDInsight overview https://aka.ms/azfr/461/03 + Azure HDInsight pricing https://aka.ms/azfr/461/04 + Siphon: Streaming data ingestion with Apache Kafka https://aka.ms/azfr/461/05 + Create a free account (Azure) https://aka.ms/azfr/461/free

Published 2018-08-09 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.

Keep exploring Learn to Code