LLMs on Kubernetes Part 1: Understanding the threat model (opens in new tab)

Let’s say you’ve got an LLM running on Kubernetes. Pods are healthy, logs are clean, users are chatting. Everything looks fine. But here’s the thing: Kubernetes is great at scheduling workloads and…