gpu Archives - DevToolHub

Ollama Docker Setup: GPU, Volumes and Compose

November 3, 2026November 9, 2026 Amaresh Pelleti

Ollama Docker setup with a persistent volume, GPU passthrough and a Compose file

Running Ollama in a container takes one docker run command. That command also decides two things the docs bury: whether your models survive a rebuild, and whether your GPU gets used. This Ollama Docker setup guide covers both. I ran… Read moreOllama Docker Setup: GPU, Volumes and Compose

Ollama Hardware Requirements: RAM, VRAM and GPU

September 4, 2026November 3, 2026 Amaresh Pelleti

Ollama hardware requirements chart showing RAM and VRAM by model size

Ollama runs a model by loading its weights into memory. So the size of the model file is the number that decides what hardware you need. For example, a 4-bit 8B model is about 5 GB on disk. It needs… Read moreOllama Hardware Requirements: RAM, VRAM and GPU