Show HN: AI-Gateway – Open-source semantic caching proxy to reduce LLM API costs (opens in new tab)
AI-Gateway reverse proxy that uses semantic caching and aims to reduce LLM API bills and token costs by 40-70%. - Arnab758/ai-gateway
Read the original article