tubeshowcase●1,672,743 videos♡ My collection 0
← Learn to Code

Learn to Code30:41

Faster AI Responses with Semantic Caching in Azure Managed Redis | OD823

Microsoft Developer ↗

From the creator

AI apps are only as efficient as how they handle repeated intent. In this demo, see how semantic caching with Azure Managed Redis identifies similar requests and serves responses instantly—without reprocessing tokens. Compare a standard LLM workflow to a cached experience in real time, and learn how vector similarity search reduces latency, cuts token usage, and lowers cost for scalable AI apps. To learn more, please check out these resources: * https://aka.ms/build26-next-steps 𝗦𝗽𝗲𝗮𝗸𝗲𝗿𝘀: * Philip Laussermair 𝗦𝗲𝘀𝘀𝗶𝗼𝗻 𝗜𝗻𝗳𝗼𝗿𝗺𝗮𝘁𝗶𝗼𝗻: This is one of many sessions from the Microsoft Build 2026 event. View even more sessions on-demand and learn about Microsoft Build at https://build.microsoft.com OD823 | English (US) | Cloud platform & data Pre-recorded | (200) Intermediate #MSBuild Chapters: 0:00 - Introduction to Azure Managed Redis and its role in AI app development 00:01:10 - Overview of Azure Managed Redis features and advantages 00:02:37 - Understanding AI agents and production challenges 00:05:18 - Key challenges: Cost management and memory/context in AI agents 00:06:27 - Transition to Philip illustrating semantic caching use case 00:06:37 - Redis Search module as the secret sauce for vector similarity search 00:10:58 - Live demo: Semantic caching reducing token usage and improving performance 00:15:18 - Exploring vector similarity thresholds and cache configurations 00:19:00 - Semantic caching ROI and cost savings analysis 00:19:57 - Roy explains agent memory us

Published 2026-06-03 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.

Keep exploring Learn to Code