Show HN: AI-Gateway – Open-source semantic caching proxy to reduce LLM API costs

AI-Gateway reverse proxy that uses semantic caching and aims to reduce LLM API bills and token costs by 40-70%. - Arnab758/ai-gateway

View Post on Scour ↗

More from GitHub on Scour.

Discussed on Hacker News