⚡ LLM Quantization - akapaka · Scour

Show HN: Ext-Infer

infer.displace.tech··Hacker News

Apple rebuilt its on-device AI stack at WWDC 2026

🤖Machine Learning Blog

ziraph.com··Hacker News

Nvidia DGX Spark GB10 – AI Models and Guide with vLLM and Autonomous Script

🧠LLM Inference Code

github.com··Hacker News

Florian Brand, Prime Intellect research engineer, adopts Gemma 4 E4B 6-bit quantized as his primary local Mac LLM

🤖Qwen News

digg.com··Hacker News

heterodoxin/graphkv: Graph-guided KV cache compression for memory-efficient LLM inference.

🧠LLM Inference Code

github.com··r/LocalLLaMA

harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.

🧠LLM Inference Code

github.com··Hacker News

defai-digital/ax-engine: Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes

🤖Qwen Code

github.com··Hacker News

Qwen3.6 + MTP: Calculated context size is smaller when I use `--spec-draft-type-* q4_0`. is this normal? · ggml-org llama.cpp · Discussion #24102

🧠Local llm Discussion Code

github.com··r/LocalLLaMA

Does anyone know what PCIe mode was used for these benchmarks?

🧠LLM Inference Code

github.com··r/LocalLLaMA

model: Granite4 Vision by gabe-l-hart · Pull Request #23545 · ggml-org/llama.cpp

🧠Local llm Code

github.com··r/LocalLLaMA

[PoC] server: support requantizing kv cache by wadealexc · Pull Request #24134 · ggml-org/llama.cpp

🧠LLM Inference Code

github.com··r/LocalLLaMA

sk8erboi17/DStudio: Run DeepSeek V4 fully local: chat, a coding agent, and a design studio in one private desktop app.

🧠Local llm Code

github.com··Hacker News

Show HN: TuringLLM – a LLM-powered Universal Turing machine

🧠Local llm Code

github.com··Hacker News

No more posts from akapaka's subscribed feeds.

Scour all 25257 feeds Learn more about Feeds

Log in to enable infinite scrolling