PacifAIst/Quansloth: Based on the implementation of Google's TurboQuant (ICLR 2026) β Quansloth brings elite KV cache compression to local LLM inference. Quansloth is a fully private, air-gapped AI server that runs massive context models natively on consumer hardware with ease Β ποΈLLM Infrastructure
Loading...Loading more...