⚡ Quantization - ibrahimsharaf · Scour

Tetrahedroned/Agent-Braille: Deterministic 8-bit machine-to-machine protocol for AI agent state. ~92% fewer state-tracking tokens on real Claude Code sessions, a proven single-bit-error-safe command code, fully reproducible. 🤖AI Agents

github.com·2d·Hacker News

Running DramaBox on Strix Halo 🎯LLM Finetuning

sleepingrobots.com·6d

not much happened today 🤖AI Agents

news.smol.ai·5d

Less-relevant results

My Zerto Docs MCP Server: Ask Claude (or Copilot, or Cursor) Real Questions 💻Local AI

MARR: Module-Adaptive Residual Reconstruction for Low-Bit Post-Training Quantization 🚀LLM Deployment

AMD bringing FSR 4.1 ML-powered upscaling to RX 7000 series in July, RX 6000 series in 2027 🎯LLM Finetuning

·6d

michelangeloromerochisco/ternative: Inference engine for ternary-weight LLMs with runtime LoRA - the llama.cpp of BitNet models 💻Local AI

github.com·1d·Hacker News

froggeric/Qwen3.6-27B-MTP-GGUF 🚀LLM Deployment

huggingface.co·3d·DEV

KV Cache Optimization: 3x Faster LLM Inference on 24GB VRAM 🚀LLM Deployment

tildalice.io·6d

[WIP] Gemma 4 MTP by am17an · Pull Request #23398 🎯LLM Finetuning

github.com·17h·r/LocalLLaMA

Why and How to Run Local Models in Zed 💻Local AI

What happened to the Memory Bank? 💻Local AI

docs.cline.bot·4d·r/CLine

My RTX 5090 can't keep up with Apple Silicon on the biggest local LLMs, and I hate to admit it 🎯LLM Finetuning

xda-developers.com·6d

K-Quantization and its Impact on Output Performance 🚀LLM Deployment

Used over a million tokens in three separate sessions to test Qwen 3.6 35b (new Multi-token Prediction version) 🚀LLM Deployment

huggingface.co·5d·r/LocalLLaMA

AMD's FSR 4 coming to RDNA 2 could give the Xbox Series X a PS5 Pro-like upgrade 🚀LLM Deployment

tweaktown.com·5d

Tahsine/kaggle-llm-server: Run a free 35B multimodal LLM on Kaggle GPU — accessible from any OpenAI-compatible client 🚀LLM Deployment

github.com·1d·DEV

Pokemon NPCs Powered by Local LLMs 🧪Synthetic Data

owenmc.dev·3d·Hacker News

AI boom is pricing out PC builders and bootstrapped AI startups 💻Local AI

startupfortune.com·4d

Do All Large Language Models Have Emotions? ⚙️Transformers

Sign up or log in to see more results

Log in to enable infinite scrolling