Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Quantization
⚡ Quantization
Model Compression, INT8, Weight Quantization
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
103
posts in
8.2
ms
GGUF
vs
GPTQ
vs
AWQ
: The Plain-English Guide to LLM Quantization (and Which One to Pick)
💬
LLMs
vettedconsumer.com
·
4d
4 days ago
·
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
Understanding
Quantization-Aware
Training
: Gradients at Quantized Weights Bias to the Low-Loss Basin
🤖
AI
Content type:
Academic
arxiv.org
·
1d
1 day ago
Actions for Understanding Quantization-Aware Training: Gradients at Quantized Weights Bias to the Low-Loss Basin
Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA
🎮
Game Engines
everylocalai.com
·
5h
5 hours ago
·
DEV
Actions for Ollama 0.30 GPU Boost: Faster local Qwen inference on NVIDIA
Qwen 3.6 27B AutoRound
GGUF
, need your feedback
💬
LLMs
huggingface.co
·
1d
1 day ago
·
r/LocalLLaMA
Actions for Qwen 3.6 27B AutoRound GGUF, need your feedback
Gemma 4 QAT
models
: Optimizing model
compression
for mobile and laptop efficiency
💬
LLMs
Content type:
News
Content type:
Blog
blog.google
·
5d
5 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
146th airhacks tv: Rust, Java 25, AI Agents, BCE, Web Components, zunit, zb
💬
LLMs
Content type:
Blog
adambien.blog
·
23h
23 hours ago
Actions for 146th airhacks tv: Rust, Java 25, AI Agents, BCE, Web Components, zunit, zb
KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for
llama.cpp
, fully measured on real hardware.
💬
LLMs
Content type:
Code
github.com
·
10h
10 hours ago
·
Hacker News
Actions for KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.
Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support
🎮
Game Engines
alternativeto.net
·
2d
2 days ago
Actions for Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support
The latest Gemma 4
models
use a
training
trick to slash their on-device memory footprint
💬
Natural Language Processing
androidauthority.com
·
5d
5 days ago
Actions for The latest Gemma 4 models use a training trick to slash their on-device memory footprint
Unsloth Gemma 4 QAT
🤖
AI
unsloth.ai
·
5d
5 days ago
Actions for Unsloth Gemma 4 QAT
Google Shrank Gemma 4 by 72% and Unsloth Fixed the
4-Bit
Bug Nobody Else Caught on One 4090, and
4-Bit
Shouldn’t Be This Good
💬
LLMs
Content type:
Blog
towardsai.net
·
2d
2 days ago
Actions for Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good
Pruned YOLOv8 ONNX
INT8
Fails: 3 Fixes That Work
🧠
Neural Networks
Content type:
Blog
Content type:
Discussion
tildalice.io
·
5d
5 days ago
Actions for Pruned YOLOv8 ONNX INT8 Fails: 3 Fixes That Work
Here's a
llama.cpp
CLI Command builder.
💬
LLMs
llamabuilding.com
·
2d
2 days ago
·
r/LocalLLaMA
Actions for Here's a llama.cpp CLI Command builder.
MoQ
GGUFs
and GSQ:
Low-Bit
GGUFs
Are About to Get Much Better
🎛️
Fine-tuning
Content type:
News
Content type:
Blog
kaitchup.substack.com
·
5d
5 days ago
·
r/LocalLLaMA
Actions for MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better
Optimal
Post-Training
Quantization
Scales and Where to Find Them
💬
LLMs
Content type:
Academic
arxiv.org
·
22h
22 hours ago
Actions for Optimal Post-Training Quantization Scales and Where to Find Them
Improved performance and
model
support with
GGUF
🎮
Game Engines
Content type:
Blog
ollama.com
·
6d
6 days ago
Actions for Improved performance and model support with GGUF
lightmetal: GPU LLM Inference From a Single Java 25 JAR
💬
LLMs
Content type:
Blog
adambien.blog
·
1d
1 day ago
Actions for lightmetal: GPU LLM Inference From a Single Java 25 JAR
Google DeepMind releases Gemma 4 QAT, but Unsloth developer Daniel Han warns naive
llama.cpp
conversions suffer accuracy loss
💬
LLMs
Content type:
News
digg.com
·
5d
5 days ago
Actions for Google DeepMind releases Gemma 4 QAT, but Unsloth developer Daniel Han warns naive llama.cpp conversions suffer accuracy loss
local llm on laptop 780M GPU using
llama
+ gemma 4 qat
💬
LLMs
Content type:
Blog
alper.bearblog.dev
·
4d
4 days ago
Actions for local llm on laptop 780M GPU using llama + gemma 4 qat
DeskDash - a free Windows tool to easily manage your
GGUF
files
✍️
Prompt Engineering
gerry7.itch.io
·
3d
3 days ago
·
r/LocalLLaMA
Actions for DeskDash - a free Windows tool to easily manage your GGUF files
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help