Kubernetes as AI Infrastructure: Google Cloud, llm-d, and the CNCF (opens in new tab)
llm-d is officially a CNCF Sandbox project. As a key component of GKE Inference Gateway, llm-d is central to how Google Cloud supports AI inference.
Read the original article