The Easiest Ways to Run LLMs Locally - Docker Model Runner Tutorial

From the creator

Download Docker Desktop: https://docs.docker.com/desktop/ Docker Model Runner Docs: https://docs.docker.com/ai/model-runner/ There's now an even easier way to run AI models locally other than using Ollama. Now Docker just released their model runner and this is a complete game changer for running models locally. Now, just like Ollama, you can manage, run and deploy models locally with OpenAI compliant API. And all of this is built right into Docker desktop. Want to make real money with coding? I share high-signal insights on careers, monetization, and leverage in my free newsletter. Join here and get my guide How to Make Money With Coding instantly: https://techwithtim.net/newsletter ⏳ Timestamps ⏳ 00:00 | Introducing Docker Model Runner 00:54 | System Requirements 02:19 | Setup/Install 03:50 | Using Models from Docker Desktop 04:12 | Using Models from Command Line 06:41 | How it Works 07:43 | Model Runner vs Ollama 09:11 | Simple Python Example 12:22 | Containerized Application Example Hashtags #Docker #Ollama #LLMs

Published 2025-07-19 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.