Back to article

TurboQuant: Online Vector Quantization with Near-optimal Distortion Rate (opens in new tab)

Covered by 4 sources including Towards Data Science, GitHubDiscussed on Hacker News

Covered in 7 articles

Towards Data Science·

Qdrant TurboQuant Explained: Is TurboQuant the Silver Bullet?

RunEdgeAI/turboquant.cpp: Near-optimal online vector quantization in C++23 — 1-4 bits per coordinate, no training, no codebooks

Discussed on Hacker News

I built a graph-memory layer on top of turbovec for local/constrained RAG — looking for feedback

Discussed on r/LocalLLaMA

KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

Discussed on Hacker News

RyanCodrai/turbovec: A vector index built on TurboQuant, written in Rust with Python bindings

Discussed on Hacker News, r/golang, and r/singularity

aws.amazon.com·

Accelerate LLM model loading and increase context windows with GPUDirect on Amazon FSx for Lustre and TurboQuant

In other languages

Pangyoalto Blog·

[벡터 압축 시리즈 2] [논문 리뷰] TurboQuant: Online Vector Quantization