RyanCodrai/turbovec: A vector index built on TurboQuant, written in Rust with Python bindings (opens in new tab)

Covers TurboQuant: Online Vector Quantization with Near-optimal Distortion RateCovered by 3 sources including Nitter, 何夕2077的个人站Discussed on Hacker News, r/golang, and r/singularity

A vector index built on TurboQuant, written in Rust with Python bindings A 10 million document corpus takes 31 GB of RAM as float32. turbovec fits it in 4 GB - and searches it faster than FAISS. turbovec is a Rust vector index with Python bindings, built on Google Research's Online ingest. Add vectors, they're indexed — no train step, no parameter tuning, no rebuilds as the corpus grows. Faster than FAISS. Hand-written NEON (ARM) and AVX-512BW (x86) kernels beat FAISS IndexPQFastScan by 12–20...

Read the original article

Sign in to keep reading the full article.

Sign Up Log In

Covered in 4 articles

Nitter·

I don’t know whether to take these specific details like this seriously, but something like this will inevitably happen, sooner or later — and absolutely devast...

Nitter·

I don’t know whether to take these specific details like this, but something like this will happen, sooner or later, and absolutely destroy all the data structu...

MLWhiz·

The week AI infrastructure crossed from a technology story to a financial one

View all 4 ›