Reliable AWS Lambda Data Pipelines with AsyncAPI Specification • Hari Krishnan • GOTO 2025

From the creator

This presentation was recorded at GOTO Serverless 2025. #GOTOcon #GOTOserverless https://conferences.gotopia.tech/goto-serverless-bengaluru-2025 Hari Krishnan - Co-founder and CTO at Specmatic @harikrishnan1913 RESOURCES https://twitter.com/HariKrishnan83 https://www.linkedin.com/in/harikrishnan83 https://github.com/harikrishnan83 https://medium.com/@harikrishnan https://about.me/harikrishnan83 Links https://www.asyncapi.com https://specmatic.io https://github.com/specmatic/aws-lambda-kafka-with-localstack ABSTRACT Event-driven architectures powered by Kafka and AWS Lambda are increasingly popular for real-time analytics pipelines. However, schema compatibility issues between Lambda functions are often detected too late—during end-to-end or integration testing—making them expensive to fix. What if we could define and validate event schemas before integration, ensuring compatibility between Lambda functions and pipeline stages early in the development cycle? In this talk, I’ll share practical lessons from building real-world Kafka–Lambda pipelines and demonstrate how we use the AsyncAPI Specification as an executable contract to detect schema mismatches early and ensure reliable data transformation. We’ll model Kafka topics and event schemas (Avro, XML, JSON, etc.) using AsyncAPI 3.0’s request-reply pattern, and show how we can use the same for automated contract testing with Specmatic to verify each Lambda function’s input-output compatibility in isolation. Attendees

Published 2025-12-08 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.