Running Gemma 4 Local AI

From the creator

How to run Gemma 4 open local AI models in LM Studio on a computer with integrated graphics (like most laptops and mini PCs). Although everything here will also work just fine on a system with a dedicated graphics card. You can download the version of LM Studio shown in the video here: https://lmstudio.ai/download -- where is the SECOND download on offer. I note this because, in the days since the video was made, a new agentic application called "LM Studio Bionic" was released, and it is this program that is now linked on the LM Studio homepage and is now listed first on the download page. If you enjoy this video, you may also like my episode on Agentic AI: https://www.youtube.com/watch?v=Gvt4TwGpqOs CONFIGURATION NOTES There are lots of settings that you can experiment with when running LLMs like Gemma 4 locally, especially if you have a powerful dedicated GPU with a lot of VRAM. But on my system with integrated graphics, I experimented with the following changes: CONTEXT LENGTH: Go to “My Models”, click on the gear icon to access the settings for a particular model, and then click on the “Load” tab. Here you can set the “Context Length” for a model, which on my system for Gemma 4 12B defaulted to 8192 tokens. However, I tried reducing this to 4096 to save resources and increase speed. But I put this back to 8196 for the test summarizing the 3900 word book chapter. CPU THREAD POOL SIZE: in the settings for a model, under the “Inference” tab you will find a control for t

Published 2026-07-26 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.