Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Quantization
⚡ Quantization
Specific
model quantization, GGUF, int4, int8, bitsandbytes
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
58
posts in
12.5
ms
Running Qwen 35B MoE at 450k Context on a Single 32GB GPU
🔓
Open-source Models
local-llm.utop.workers.dev
·
4d
4 days ago
·
Hacker News
Actions for Running Qwen 35B MoE at 450k Context on a Single 32GB GPU
Less-relevant results
Apples to Apples: MLX vs.
Llama.cpp
for Gemma 4 12B on an M1 16GB
🧠
LLMs
Content type:
Blog
ziraph.com
·
5d
5 days ago
·
Hacker News
Actions for Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB
Show HN:
Ext-Infer
🔧
Tool Use
infer.displace.tech
·
4d
4 days ago
·
Hacker News
Actions for Show HN: Ext-Infer
Gemma 4 12B: A unified, encoder-free multimodal
model
🔓
Open-source Models
Content type:
Discussion
news.ycombinator.com
·
4d
4 days ago
·
Hacker News
Actions for Gemma 4 12B: A unified, encoder-free multimodal model
Building & Benchmarking: LLMs on a 16GB Jetson Orin NX for Hermes Agent
🔧
Tool Use
Content type:
Blog
dnhkng.github.io
·
2d
2 days ago
Actions for Building & Benchmarking: LLMs on a 16GB Jetson Orin NX for Hermes Agent
Holding the FP8 Quality Ceiling at
8-Bit
Weights and Activations:
INT8
and
GGUF
Post-Training Quantization of Ideogram 4.0 for Consumer GPUs
🔓
Open-source Models
Content type:
Academic
arxiv.org
·
11h
11 hours ago
Actions for Holding the FP8 Quality Ceiling at 8-Bit Weights and Activations: INT8 and GGUF Post-Training Quantization of Ideogram 4.0 for Consumer GPUs
Nvidia DGX Spark GB10 – AI
Models
and Guide with
vLLM
and Autonomous Script
🧠
LLMs
Content type:
Code
github.com
·
5d
5 days ago
·
Hacker News
Actions for Nvidia DGX Spark GB10 – AI Models and Guide with vLLM and Autonomous Script
BeeLlama.cpp
DFlash on Strix Halo: 2.7x Gemma 31B, But MTP Is Still Faster
🔓
Open-source Models
sleepingrobots.com
·
4d
4 days ago
Actions for BeeLlama.cpp DFlash on Strix Halo: 2.7x Gemma 31B, But MTP Is Still Faster
Google DeepMind releases Gemma 4 QAT, but Unsloth developer Daniel Han warns naive
llama.cpp
conversions suffer accuracy loss
🧠
LLMs
Content type:
News
digg.com
·
5d
5 days ago
Actions for Google DeepMind releases Gemma 4 QAT, but Unsloth developer Daniel Han warns naive llama.cpp conversions suffer accuracy loss
Google Shrank Gemma 4 by 72% and Unsloth Fixed the
4-Bit
Bug Nobody Else Caught on One 4090, and
4-Bit
Shouldn’t Be This Good
🧠
LLMs
Content type:
Blog
towardsai.net
·
3d
3 days ago
Actions for Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good
Ideogram4
GGUF
is out!
🔓
Open-source Models
huggingface.co
·
4d
4 days ago
·
r/StableDiffusion
Actions for Ideogram4 GGUF is out!
Apple rebuilt its on-device AI stack at WWDC 2026
🎭
Multimodal AI
Content type:
Blog
ziraph.com
·
2d
2 days ago
·
Hacker News
Actions for Apple rebuilt its on-device AI stack at WWDC 2026
I wired a fully offline voice loop to Ollama + LM Studio — 100% CPU, no GPU, nothing leaves your machine (Silero VAD + Parakeet STT + Supertonic TTS 3)
🕵️
AI Agents
Content type:
Code
github.com
·
13h
13 hours ago
·
r/LocalLLaMA
Actions for I wired a fully offline voice loop to Ollama + LM Studio — 100% CPU, no GPU, nothing leaves your machine (Silero VAD + Parakeet STT + Supertonic TTS 3)
Gemma 4 QAT
models
: Optimizing model compression for mobile and laptop efficiency
🔓
Open-source Models
Content type:
News
Content type:
Blog
blog.google
·
5d
5 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
Florian Brand, Prime
Intellect
research engineer, adopts Gemma 4 E4B
6-bit
quantized
as his primary local Mac LLM
🔓
Open-source Models
Content type:
News
digg.com
·
4d
4 days ago
·
Hacker News
Actions for Florian Brand, Prime Intellect research engineer, adopts Gemma 4 E4B 6-bit quantized as his primary local Mac LLM
Launch HN: General Instinct (YC P26) – Frontier
models
on edge devices
🔓
Open-source Models
Content type:
Discussion
news.ycombinator.com
·
5d
5 days ago
·
Hacker News
Actions for Launch HN: General Instinct (YC P26) – Frontier models on edge devices
not much happened today | AINews
🕵️
AI Agents
news.smol.ai
·
6d
6 days ago
Actions for not much happened today | AINews
defai-digital/ax-engine: Apple Silicon
LLM
runtime supporting Gemma 4 and Qwen 3.6 MTP
modes
🔓
Open-source Models
Content type:
Code
github.com
·
1d
1 day ago
·
Hacker News
Actions for defai-digital/ax-engine: Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes
FADA: Accessible fetal ultrasound
interpretation
and annotation with a selectively distilled unified vision-language
model
👁️
VLMs
Content type:
Academic
arxiv.org
·
1d
1 day ago
Actions for FADA: Accessible fetal ultrasound interpretation and annotation with a selectively distilled unified vision-language model
The latest Gemma 4
models
use a training trick to slash their on-device memory footprint
🔓
Open-source Models
androidauthority.com
·
5d
5 days ago
Actions for The latest Gemma 4 models use a training trick to slash their on-device memory footprint
« Page 1
·
Page 3 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help