One go-to control plane for local inference (opens in new tab)

Discussed on Hacker News

One UI for model state, request history, API keys, routing rules, and proxy metrics — fronting llama-swap and any OpenAI- or Anthropic-compatible upstream.

Read the original article