Cache-Aware Spawning: What Changed in llm-cli-gateway, a Week On (opens in new tab)
If your multi-LLM workload sends the same long system prompt or file dump to Claude / Codex / Gemini ten times an hour, you are paying for the same input tokens ten times. Each provider has a cache for exactly this case, and each one expresses the cache differently. This post is about how llm-cli-gateway now uses those caches for you, across all five providers, without you having to re-implement the per-provider cache APIs yourself. I covered last week, and I closed that piece with a teaser, ...
Read the original article