Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Inference
⚙️ Inference
model inference, serving, quantization, throughput, vLLM
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
349
posts in
9.1
ms
The Bill Arrives: How to Manage Agentic AI Costs at Scale
🧠
AI
Content type:
Blog
cockroachlabs.com
·
20h
20 hours ago
Actions for The Bill Arrives: How to Manage Agentic AI Costs at Scale
Two Leaps to 1000 Tokens/s on a 1T-Parameter
Model
: On
Inference
Systems, Execution Boundaries, and Co-Design
🕵️
AI Agents
Content type:
Blog
tilert.ai
·
2d
2 days ago
·
Hacker News
Actions for Two Leaps to 1000 Tokens/s on a 1T-Parameter Model: On Inference Systems, Execution Boundaries, and Co-Design
Gemma 4 QAT
models
: Optimizing model compression for mobile and laptop efficiency
🧠
AI
Content type:
News
Content type:
Blog
blog.google
·
5d
5 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
Token4Token — pay-per-token
inference
on Gnosis + Swarm
🔀
LoRA
t4t.eth.link
·
1d
1 day ago
·
Hacker News
Actions for Token4Token — pay-per-token inference on Gnosis + Swarm
Ask HN: Is software
engineering
still a good career choice for new students?
🤖
Machine Learning
Content type:
Discussion
news.ycombinator.com
·
22h
22 hours ago
·
Hacker News
Actions for Ask HN: Is software engineering still a good career choice for new students?
Magenta RealTime 2: Open and Local Live Music
Models
🤖
Machine Learning
magenta.withgoogle.com
·
6d
6 days ago
·
Hacker News
,
Hacker News
,
r/LocalLLaMA
Actions for Magenta RealTime 2: Open and Local Live Music Models
Mobile AI Compute
Engine
(MACE)
inference
framework — Vision SDK
⚡
Transformers
Content type:
Blog
mapbox.com
·
2d
2 days ago
Actions for Mobile AI Compute Engine (MACE) inference framework — Vision SDK
On-device AI is a margin decision
📊
AI Evals
Content type:
Blog
ziraph.com
·
2h
2 hours ago
·
Hacker News
Actions for On-device AI is a margin decision
OpenCV Introduces New DNN
Inference
Engine
🧠
AI
i-programmer.info
·
2d
2 days ago
Actions for OpenCV Introduces New DNN Inference Engine
146th airhacks tv: Rust, Java 25, AI Agents, BCE, Web Components, zunit, zb
🤖
Machine Learning
Content type:
Blog
adambien.blog
·
17h
17 hours ago
Actions for 146th airhacks tv: Rust, Java 25, AI Agents, BCE, Web Components, zunit, zb
Pruned YOLOv8 ONNX INT8 Fails: 3 Fixes That Work
🧠
AI
Content type:
Blog
Content type:
Discussion
tildalice.io
·
5d
5 days ago
Actions for Pruned YOLOv8 ONNX INT8 Fails: 3 Fixes That Work
UniSVQ: 2-bit Unified Scalar-Vector
Quantization
🔀
LoRA
Content type:
Academic
arxiv.org
·
16h
16 hours ago
Actions for UniSVQ: 2-bit Unified Scalar-Vector Quantization
HNSW vs LSH: How Elasticsearch hits 0.99 recall@10 at 15,000 QPS — and what it costs
📐
Embeddings
Content type:
Blog
elastic.co
·
1d
1 day ago
Actions for HNSW vs LSH: How Elasticsearch hits 0.99 recall@10 at 15,000 QPS — and what it costs
DiffusionGemma: 4x Faster Text Generation
🧠
AI
Content type:
News
Content type:
Blog
blog.google
·
4h
4 hours ago
·
Hacker News
,
r/LocalLLaMA
,
r/singularity
Actions for DiffusionGemma: 4x Faster Text Generation
GGUF vs GPTQ vs AWQ: The Plain-English Guide to
LLM
Quantization
(and Which One to Pick)
🧠
AI
vettedconsumer.com
·
4d
4 days ago
·
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude (4 minute read)
🧠
AI
Content type:
News
decrypt.co
·
1d
1 day ago
Actions for China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude (4 minute read)
No Token Left Behind: Demystifying Token-in-Token-Out in Miles
💬
LLMs
Content type:
Blog
lmsys.org
·
1d
1 day ago
·
Hacker News
Actions for No Token Left Behind: Demystifying Token-in-Token-Out in Miles
Speculators v0.5.0: DFlash support and online training
🔀
LoRA
developers.redhat.com
·
6d
6 days ago
Actions for Speculators v0.5.0: DFlash support and online training
Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!
🧠
AI
gizchina.com
·
1d
1 day ago
Actions for Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!
Build a Medical Report Analyzer on Dedicated
Inference
with Python
🧠
AI
digitalocean.com
·
6d
6 days ago
Actions for Build a Medical Report Analyzer on Dedicated Inference with Python
« Page 1
·
Page 3 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help