20:40Siphon on HDInsight Kafka | Azure Friday
From the creator
Thomas Alex joins Lara Rubbelke to discuss how Microsoft uses Apache Kafka for HDInsight to power Siphon, a data ingestion service for internal use. Apache Kafka for HDInsight is an enterprise-grade, open-source, streaming ingestion service. Microsoft created Siphon as a highly available and reliable service to ingest massive amounts of data for processing in near real time. Siphon handles ingestion of over a trillion events per day across multiple business-critical scenarios at Microsoft. In this episode, learn how Siphon uses Apache Kafka for HDInsight as its scalable pub/sub message queue. [01:50] Demo Start For more information: + Quickstart: Create a Kafka on HDInsight cluster https://aka.ms/azfr/461/01 + Tutorial: Use Spark Structured Streaming with Kafka on HDInsight https://aka.ms/azfr/461/02 + Apache Kafka for HDInsight overview https://aka.ms/azfr/461/03 + Azure HDInsight pricing https://aka.ms/azfr/461/04 + Siphon: Streaming data ingestion with Apache Kafka https://aka.ms/azfr/461/05 + Create a free account (Azure) https://aka.ms/azfr/461/free
Published 2018-08-09 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.
Keep exploring Learn to Code
20:40
22:47
09:23Announcements across Microsoft SQL at Microsoft Ignite 2026 | Data Exposed
Microsoft Developer
05:34
02:05
02:17
10:51Competitive Programming Tutorial #42 | Convex hull trick: turn the DP into lines
SyntaxPilot