Local AI without memory limits: how QVAC’s latest upgrade unlocks 5x more context on your device (opens in new tab)

QVAC SDK 0.12.0, shipping June 1 2026, integrates TurboQuant, a KV-cache quantization algorithm published by Google Research at ICLR 2026. The result: on-device LLMs can now hold up to 5x more context with the same model, on the same device, with nearly no measurable accuracy loss. No code changes. No retraining.