Ollama runs a model by loading its weights into memory. So the size of the model file is the number that decides what hardware you need. For example, a 4-bit 8B model is about 5 GB on disk. It needs… Read moreOllama Hardware Requirements: RAM, VRAM and GPU