Skip to content

DevToolHub

Practical guides to Git, CI/CD, AI tools, and AWS, Azure and GCP

  • Home
  • AI Tools
  • Cloud
  • Docker
  • Kubernetes
  • Git
  • GitHub Actions
  • About

Tag: Ollama

Ollama Docker Setup: GPU, Volumes and Compose

November 3, 2026November 9, 2026 Amaresh Pelleti
Ollama Docker setup with a persistent volume, GPU passthrough and a Compose file

Running Ollama in a container takes one docker run command. That command also decides two things the docs bury: whether your models survive a rebuild, and whether your GPU gets used. This Ollama Docker setup guide covers both. I ran… Read moreOllama Docker Setup: GPU, Volumes and Compose

AI Tools  Docker, docker-compose, gpu, Ollama

Ollama vs vLLM vs llama.cpp: Which Local LLM Engine?

October 1, 2026October 22, 2026 Amaresh Pelleti
ollama vs vllm vs llama.cpp comparison of local LLM engines and concurrency

Ollama vs vLLM vs llama.cpp comes down to one question: how many people will hit the model at once? For one developer on a laptop, pick Ollama or llama.cpp. For a GPU server with many concurrent users, pick vLLM. Below,… Read moreOllama vs vLLM vs llama.cpp: Which Local LLM Engine?

AI Tools  llama-cpp, local-llm, Ollama, vllm

Ollama Production Deployment: systemd, TLS, and API Auth

September 21, 2026 Amaresh Pelleti
ollama production deployment diagram showing nginx TLS termination and API key auth in front of the Ollama service

Ollama production deployment means three things the official docs don’t cover: the default systemd unit runs Ollama unsandboxed, the reverse-proxy example in Ollama’s own FAQ has no TLS and no auth, and there’s no built-in authentication at all — anyone… Read moreOllama Production Deployment: systemd, TLS, and API Auth

AI Tools  AI Tools, Linux, Ollama, Self-hosted AI

AI Agents Explained: How They Actually Work

September 17, 2026November 11, 2026 Amaresh Pelleti
ai agents explained diagram showing the observe, decide, act, tool call loop

AI agents explained in one sentence: software where an LLM decides what to do next, based on the result of what it just did, in a loop, instead of following a script you wrote in advance. It picks which tool… Read moreAI Agents Explained: How They Actually Work

AI Tools  AI Agents, AI Tools, LLM, MCP, Ollama

What Is RAG? Retrieval-Augmented Generation Explained

September 15, 2026 Amaresh Pelleti
what is RAG diagram showing retrieval, vector search, and generation pipeline

What is RAG, in one sentence? A way to make an LLM answer questions using documents it was never trained on. It searches those documents for relevant passages, then hands the model the results as context before generating a response…. Read moreWhat Is RAG? Retrieval-Augmented Generation Explained

AI Tools  AI Tools, LLM, Ollama, rag, vector database

What Is an LLM? A Working Model for Engineers

September 14, 2026November 16, 2026 Amaresh Pelleti
what is an LLM diagram showing tokens, context window, and next-token prediction

What is an LLM, in one sentence? A model that has one job: given the text so far, predict the next token, append it, and repeat. That’s it. Everything else — chat interfaces, coding assistants, agents that call tools —… Read moreWhat Is an LLM? A Working Model for Engineers

AI Tools  AI Concepts, AI Tools, large language models, LLM, Ollama

Ollama Model Library, By the Numbers

September 6, 2026November 16, 2026 Amaresh Pelleti
Ollama model library capability breakdown across 239 models

Someone asks “what’s the best Ollama model” in a Discord or a Reddit thread almost every day. The answer usually comes from memory, or a single favorite. So we pulled the actual data instead. Every model in the Ollama model… Read moreOllama Model Library, By the Numbers

AI Tools  ai-tools, local-llm, Ollama, open-source-models

Ollama API: A Practical Guide with Examples

September 4, 2026November 20, 2026 Amaresh Pelleti
Ollama API request and streaming response flow

Every Ollama install runs a local HTTP server on port 11434, and that server is the real interface to the models. The ollama run command is a thin client on top of it. Once you know the two main endpoints,… Read moreOllama API: A Practical Guide with Examples

AI Tools  AI Tools, API, local llm, Ollama, Python

Ollama Hardware Requirements: RAM, VRAM and GPU

September 4, 2026November 20, 2026 Amaresh Pelleti
Ollama hardware requirements chart showing RAM and VRAM by model size

Ollama runs a model by loading its weights into memory. So the size of the model file is the number that decides what hardware you need. For example, a 4-bit 8B model is about 5 GB on disk. It needs… Read moreOllama Hardware Requirements: RAM, VRAM and GPU

AI Tools  AI Tools, gpu, hardware, local llm, Ollama

Ollama vs LM Studio: Which One Should You Use

September 4, 2026October 1, 2026 Amaresh Pelleti
Ollama vs LM Studio comparison for running local LLMs

Ollama vs LM Studio is a choice most people run into within a week of trying local models. Both tools run open-weight language models on your own machine, pull from the same pool of GGUF model files, and expose an… Read moreOllama vs LM Studio: Which One Should You Use

AI Tools  AI Tools, LM Studio, local llm, Ollama, self-hosting

Posts pagination

Page 1 Page 2 Next page

Get the next DevToolHub guide

New guides on Git, GitHub Actions, AI tools, and cloud (AWS, Azure, GCP), delivered to your inbox. Subscribe for troubleshooting steps, configuration examples, and explanations of the trade-offs.

Topics

  • Home
  • AI Tools
  • Cloud
  • Docker
  • Kubernetes
  • Git
  • GitHub Actions
  • About
  • Blog
  • Privacy Policy
  • About
  • Affiliate Disclosure
  • Terms and Conditions
  • Resources
© 2026 All rights reserved
Go to top