Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Quantization
⚡ Quantization
Specific
GGUF, GPTQ, AWQ, int4, model compression
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
215
posts in
6.1
ms
GGUF
vs
GPTQ
vs
AWQ
: The Plain-English Guide to LLM Quantization (and Which One to Pick)
💻
Local AI
vettedconsumer.com
·
4d
4 days ago
·
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
Quality Is Not a Safety Proxy Under
Quantization
💻
Local AI
Content type:
Academic
arxiv.org
·
15h
15 hours ago
Actions for Quality Is Not a Safety Proxy Under Quantization
Qwen 3.6 27B AutoRound
GGUF
, need your feedback
💻
Local AI
huggingface.co
·
1d
1 day ago
·
r/LocalLLaMA
Actions for Qwen 3.6 27B AutoRound GGUF, need your feedback
lightmetal: GPU LLM
Inference
From a Single Java 25 JAR
💻
Local AI
Content type:
Blog
adambien.blog
·
1d
1 day ago
Actions for lightmetal: GPU LLM Inference From a Single Java 25 JAR
Unsloth Gemma 4 QAT
💻
Local AI
unsloth.ai
·
5d
5 days ago
Actions for Unsloth Gemma 4 QAT
The
Inference
Alpha: Maximizing Frontier
Models
on AMD
⚡
Continuous Batching
Content type:
Blog
digitalocean.com
·
4h
4 hours ago
Actions for The Inference Alpha: Maximizing Frontier Models on AMD
A system programmer’s guide to LLM
inference
⚡
Continuous Batching
Content type:
Blog
blog.xiangpeng.systems
·
2d
2 days ago
·
Hacker News
Actions for A system programmer’s guide to LLM inference
Ultrafast machine learning on FPGAs via Kolmogorov-Arnold Networks
💻
Local AI
aarushgupta.io
·
23h
23 hours ago
·
Lobsters
,
Hacker News
Actions for Ultrafast machine learning on FPGAs via Kolmogorov-Arnold Networks
MoQ
GGUFs
and GSQ:
Low-Bit
GGUFs
Are About to Get Much Better
💻
Local AI
Content type:
News
Content type:
Blog
kaitchup.substack.com
·
4d
4 days ago
·
r/LocalLLaMA
Actions for MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better
HNSW vs LSH: How Elasticsearch hits 0.99 recall@10 at 15,000 QPS — and what it costs
📇
Vector Indexing
Content type:
Blog
elastic.co
·
1d
1 day ago
Actions for HNSW vs LSH: How Elasticsearch hits 0.99 recall@10 at 15,000 QPS — and what it costs
Improved performance and
model
support with
GGUF
💻
Local AI
Content type:
Blog
ollama.com
·
5d
5 days ago
Actions for Improved performance and model support with GGUF
Less-relevant results
KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for
llama.cpp
, fully measured on real hardware.
🚀
LLM Deployment
Content type:
Code
github.com
·
3h
3 hours ago
·
Hacker News
Actions for KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.
Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support
💻
Local AI
alternativeto.net
·
2d
2 days ago
Actions for Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support
Pruned YOLOv8 ONNX
INT8
Fails: 3 Fixes That Work
🎯
LLM Finetuning
Content type:
Blog
Content type:
Discussion
tildalice.io
·
5d
5 days ago
Actions for Pruned YOLOv8 ONNX INT8 Fails: 3 Fixes That Work
Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!
🚀
LLM Deployment
gizchina.com
·
1d
1 day ago
Actions for Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!
Gemma 4 QAT
models
: Optimizing model
compression
for mobile and laptop efficiency
🚀
LLM Deployment
Content type:
News
Content type:
Blog
blog.google
·
5d
5 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude (4 minute read)
⚡
Speculative Decoding
Content type:
News
decrypt.co
·
1d
1 day ago
Actions for China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude (4 minute read)
TFLite Edge
Model
Quantizer
Snippet
⚡
Speculative Decoding
itsevilduck.gumroad.com
·
2d
2 days ago
·
DEV
Actions for TFLite Edge Model Quantizer Snippet
The latest Gemma 4
models
use a training trick to slash their on-device memory footprint
🔓
Open Source AI
androidauthority.com
·
4d
4 days ago
Actions for The latest Gemma 4 models use a training trick to slash their on-device memory footprint
146th airhacks tv: Rust, Java 25, AI Agents, BCE, Web Components, zunit, zb
🤖
LLMs
Content type:
Blog
adambien.blog
·
16h
16 hours ago
Actions for 146th airhacks tv: Rust, Java 25, AI Agents, BCE, Web Components, zunit, zb
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help