Unweight: We compressed an LLM 22% without sacrificing quality (opens in new tab)

--- description: Running LLMs across Cloudflare’s network requires us to be smarter and more efficient about GPU memory bandwidth. That’s why we developed Unweight, a lossless inference-time compression system that achieves up to a 22% model footprint reduction, so that we can deliver faster and cheaper inference than ever before. title: Unweight: how we compressed an LLM 22% without sacrificing quality image: --- # Unweight: how we compressed an LLM 22% without sacrificing quality 2026-04...