⚡ LLM Quantization - akapaka

🧠Local llm Academic

arxiv.org·

Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA

🧠Local llm

everylocalai.com··DEV

Qwen 3.6 27B AutoRound GGUF, need your feedback

🧠Local llm

huggingface.co··r/LocalLLaMA

Unsloth Gemma 4 QAT

🧠Local llm

unsloth.ai·

lightmetal: GPU LLM Inference From a Single Java 25 JAR

🧠Local llm Blog

adambien.blog·

Improved performance and model support with GGUF

🧠Local llm Blog

ollama.com·

Less-relevant results

KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

🧠LLM Inference Code

github.com··Hacker News

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

🧠Local llm

alternativeto.net·

MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better

🧠LLM Inference News Blog

kaitchup.substack.com··r/LocalLLaMA

local llm on laptop 780M GPU using llama + gemma 4 qat

🧠Local llm Blog

alper.bearblog.dev·

What's in the Box? A Field Guide to AI Models

🧠LLM Inference Blog

iankduncan.com·

stable-diffusion.cpp/docs/quantization_and_gguf.md at master · leejet/stable-diffusion.cpp

🧠LLM Inference Code

github.com··r/StableDiffusion

Here's a llama.cpp CLI Command builder.

🧠Local llm

llamabuilding.com··r/LocalLLaMA

DeskDash - a free Windows tool to easily manage your GGUF files

🧠Local llm

gerry7.itch.io··r/LocalLLaMA

Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency

🧠Local llm News Blog

blog.google··Hacker News

Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM

🧠Local llm

deemwar-products.github.io··Hacker News

fix(memory): move local llama.cpp runtime to provider plugin · openclaw/openclaw@3137110

🧠Local llm Code

github.com·

Google DeepMind releases Gemma 4 QAT, but Unsloth developer Daniel Han warns naive llama.cpp conversions suffer accuracy loss

🧠Local llm News

digg.com·

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

🧠Local llm Blog

towardsai.net·

GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)

Quality Is Not a Safety Proxy Under Quantization

Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA

Qwen 3.6 27B AutoRound GGUF, need your feedback

Unsloth Gemma 4 QAT

lightmetal: GPU LLM Inference From a Single Java 25 JAR

Improved performance and model support with GGUF

KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support

MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better

local llm on laptop 780M GPU using llama + gemma 4 qat

What's in the Box? A Field Guide to AI Models

stable-diffusion.cpp/docs/quantization_and_gguf.md at master · leejet/stable-diffusion.cpp

Here's a llama.cpp CLI Command builder.

DeskDash - a free Windows tool to easily manage your GGUF files

Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency

Show HN: Run Llama.cpp In-Process from Java with Project Panama FFM

fix(memory): move local llama.cpp runtime to provider plugin · openclaw/openclaw@3137110

Google DeepMind releases Gemma 4 QAT, but Unsloth developer Daniel Han warns naive llama.cpp conversions suffer accuracy loss

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good