Self-Hosted Ollama Homelab: 3 Mistakes Running Local LLMs (opens in new tab)

Originally published on kuryzhev.cloud We thought setting up a self-hosted Ollama homelab for DevOps assistance would take an afternoon. Three OOM crashes, one exposed API endpoint, and a silent CPU fallback later, here's what actually works — and what we'd do differently from day one. Context: Why We Wanted a Local LLM for Homelab Automation Our homelab runs a fairly typical self-hosted DevOps stack: Gitea for source control, Drone CI for pipelines, Proxmox for VM management, and a handful o...