Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Inference
🤖 Inference
Model Serving, Quantization, vLLM, TensorRT
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
271
posts in
7.8
ms
Token4Token — pay-per-token
inference
on Gnosis + Swarm
🧠
LLMs
t4t.eth.link
·
1d
1 day ago
·
Hacker News
Actions for Token4Token — pay-per-token inference on Gnosis + Swarm
Running Qwen 35B MoE at 450k Context on a Single 32GB GPU
🛠️
Compilers
local-llm.utop.workers.dev
·
3d
3 days ago
·
Hacker News
Actions for Running Qwen 35B MoE at 450k Context on a Single 32GB GPU
Pruned YOLOv8 ONNX INT8 Fails: 3 Fixes That Work
🤖
AI
Content type:
Blog
Content type:
Discussion
tildalice.io
·
5d
5 days ago
Actions for Pruned YOLOv8 ONNX INT8 Fails: 3 Fixes That Work
Renew
🔀
Concurrency
flathub.org
·
1d
1 day ago
Actions for Renew
Alignment Collapse Under KV Cache
Quantization
: Diagnosis and Mitigation
🧠
LLMs
Content type:
Academic
arxiv.org
·
14h
14 hours ago
Actions for Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation
China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude (4 minute read)
☁️
Cloud
Content type:
News
decrypt.co
·
1d
1 day ago
Actions for China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude (4 minute read)
Gemma 4 12B: A unified, encoder-free multimodal
model
🧠
LLMs
Content type:
Discussion
news.ycombinator.com
·
3d
3 days ago
·
Hacker News
Actions for Gemma 4 12B: A unified, encoder-free multimodal model
Building & Benchmarking: LLMs on a 16GB Jetson Orin NX for Hermes Agent
🎮
GPUs
Content type:
Blog
dnhkng.github.io
·
1d
1 day ago
Actions for Building & Benchmarking: LLMs on a 16GB Jetson Orin NX for Hermes Agent
Where to Host Your Open-Source
Model
(Under 10B Parameters)
☁️
Cloud
digitalocean.com
·
6d
6 days ago
Actions for Where to Host Your Open-Source Model (Under 10B Parameters)
BeeLlama.cpp
DFlash on Strix Halo: 2.7x Gemma 31B, But MTP Is Still Faster
🎮
GPUs
sleepingrobots.com
·
3d
3 days ago
Actions for BeeLlama.cpp DFlash on Strix Halo: 2.7x Gemma 31B, But MTP Is Still Faster
Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!
🔧
Hardware
gizchina.com
·
1d
1 day ago
Actions for Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!
Youssof Altoukhi (@Youssofal_)
🧠
LLMs
xcancel.com
·
2d
2 days ago
·
r/LocalLLaMA
Actions for Youssof Altoukhi (@Youssofal_)
huawei-csl/KVarN: KVarN is a native
vLLM
KV-cache
quantization
backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.
🧠
LLMs
Content type:
Code
github.com
·
6d
6 days ago
·
Hacker News
Actions for huawei-csl/KVarN: KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.
Optimal Post-Training
Quantization
Scales and Where to Find Them
🧠
LLMs
Content type:
Academic
arxiv.org
·
14h
14 hours ago
Actions for Optimal Post-Training Quantization Scales and Where to Find Them
Ideogram4
GGUF
is out!
🔤
PLT
huggingface.co
·
3d
3 days ago
·
r/StableDiffusion
Actions for Ideogram4 GGUF is out!
TGI
(SG)F.
🧠
LLMs
Content type:
News
theverge.com
·
4d
4 days ago
Actions for TGI(SG)F.
How to Run Gemma 4 12B Locally - The Best AI For Consumer Laptops
🧠
LLMs
Content type:
Video
youtube.com
·
6d
6 days ago
Actions for How to Run Gemma 4 12B Locally - The Best AI For Consumer Laptops
Google releases Gemma 4 QAT
models
for local AI on enterprise laptops
🏗️
MLSys
4sysops.com
·
3d
3 days ago
Actions for Google releases Gemma 4 QAT models for local AI on enterprise laptops
Latest technical articles & videos.
🧠
LLMs
certdepot.net
·
4d
4 days ago
Actions for Latest technical articles & videos.
Trainable Smooth-Rotation Transforms with Learned Channel Scales for
LLM
Quantization
🧠
LLMs
Content type:
Academic
arxiv.org
·
14h
14 hours ago
Actions for Trainable Smooth-Rotation Transforms with Learned Channel Scales for LLM Quantization
Sign up or log in to see more results
Sign Up
Login
« Page 2
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help