Show HN: Cachet – A drop-in semantic cache for LLM APIs, 100% local, in Rust (opens in new tab)
A transparent, 100%-local semantic cache for LLM APIs — drop-in proxy, one line to integrate, written in Rust - abhix2112/Cachet
Read the original article