Setup · 2:10
Installing Ollama and models
Local LLMs.
- Install Ollama.
- Download models (LLaVA, Gemma).
- Check versions on the model page.
| Model | Type |
|---|---|
| LLaVA | Vision |
| Gemma | Text |
Do this in your own tools, step by step. Ticks are saved on this device.
Tool?
Ollama.
Vision model?
LLaVA.
0:00 welcome to episode 13 of our comfy UI tutorial Series today I want to show you how to install and run the Alama tool and how you can test different large language models inside comfy UI with its help this way you can generate prompts from your instructions or even from images first we need a tool to manage all those large language models so go to the ama.com website as you can see it can manage all kinds of models like llama fi uh Mistral and lava uh if you want to learn more about it there's a docs section that links to the GitHub page you'll also find more uh links here for a quick start and additional resources back on the AMA site you have the download button where you can choose your operating system mine is Windows so I'll click download for Windows I'll save it on my desktop for now and let's see how we install it the icon features a cute llama just double click on it and then click install and wait for it to finish once it's installed you can see the Llama icon in the notification area that indicates it is running if you want
1:11 to close Al rightclick there and choose quit it's important to know this as it can use up some vram so you can close it when you're not using it to start Alama again find it in your apps by clicking on start and searching for AMA now if I click on it it might seem like nothing happened but llama has started as we can see the icon with the llama in the notification area back on the Yama website we have a section for models if I click on it we can find different models here such as llama Gemma mistol and so on lots of options to choose from the top search is a little better than the filter below so if I search for vision for example I can find models that can interpret an image and provide a description or caption for it if I search for Gemma I can see different variations of that model if I go back to the models we can also filter them by newest or uh popular here are some popular models let's say I want to install and test Gemma I can see different versions available if I click
Get the other 10 chapters, the exam and your certificate for LinkedIn, plus all 700+ AI courses.