tubeshowcase●1,669,464 videos♡ My collection 0
← Learn to Code

Learn to Code09:20

Run an AI Large Language Model (LLM) at home on your GPU

mCoding ↗

From the creator

Download Docker Desktop: https://dockr.ly/46NkFOJ This video is sponsored by Docker. https://www.docker.com/ Large Language Models (LLMs) are a type of AI model that have proven to be extremely powerful and useful for a wide variety of tasks. They may be "large" in the sense that they use billions of parameters, but that doesn't mean you need to be a big company in order to run one. In fact, you can run some of the latest and greatest LLMs on your own machine, on your GPU, completely for free. We'll see how to do all that and more in this video using Docker Desktop! We'll even write an app to detect YouTube comment spam using an LLM. ― mCoding with James Murphy (https://mcoding.io) Docker: https://www.docker.com/ Ollama: https://ollama.com/ Ollama Docker image: https://hub.docker.com/r/ollama/ollama Ollama Python: https://github.com/ollama/ollama-python GPU compatibility: https://developer.nvidia.com/cuda-gpus Docker Tutorial Video: https://youtu.be/b0HMimUb4f0 Fast Pow algorithm Video: https://youtu.be/GrNJE6ogyQU YouTube Data API Video: https://youtu.be/0F9sdRtbwkE Source code: https://github.com/mCodingLLC/VideosSampleCode SUPPORT ME ⭐ --------------------------------------------------- Sign up on Patreon to get your donor role and early access to videos! https://patreon.com/mCoding Feeling generous but don't have a Patreon? Donate via PayPal! (No sign up needed.) https://www.paypal.com/donate/?hosted_button_id=VJY5SLZ8BJHEE Want to donate crypto? Check out the re

Published 2024-08-14 · Watch on YouTube ↗
Availability and playback restrictions are controlled by the original channel.

Keep exploring Learn to Code