Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Inference
⚡ Inference
Specific
LLM inference, vLLM, model serving, inference optimization
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
352
posts in
8.0
ms
Ultrafast machine learning on FPGAs via Kolmogorov-Arnold Networks
🎛️
Fine-tuning
aarushgupta.io
·
20h
20 hours ago
·
Lobsters
,
Hacker News
Actions for Ultrafast machine learning on FPGAs via Kolmogorov-Arnold Networks
How we fight GPU scarcity without compromise
🧠
LLMs
Content type:
Blog
equixly.com
·
5d
5 days ago
·
Hacker News
Actions for How we fight GPU scarcity without compromise
Report: GKE
Inference
Gateway delivers up to 92% faster AI responses
🧠
LLMs
Content type:
Blog
cloud.google.com
·
1d
1 day ago
·
Hacker News
Actions for Report: GKE Inference Gateway delivers up to 92% faster AI responses
Token4Token — pay-per-token
inference
on Gnosis + Swarm
🧠
LLMs
t4t.eth.link
·
1d
1 day ago
·
Hacker News
Actions for Token4Token — pay-per-token inference on Gnosis + Swarm
Gemma 4 QAT
models
:
Optimizing
model compression for mobile and laptop efficiency
🌐
Open Source AI
Content type:
News
Content type:
Blog
blog.google
·
5d
5 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
libertywing/FlashMemory-Deepseek-V4: FlashMemory DS-V4 Retriever: a lightweight retriever that sparsifies DeepSeek-V4 CSA
KV-cache
. Weights available on Hugging Face.
🌐
Open Source AI
Content type:
Code
github.com
·
16h
16 hours ago
Actions for libertywing/FlashMemory-Deepseek-V4: FlashMemory DS-V4 Retriever: a lightweight retriever that sparsifies DeepSeek-V4 CSA KV-cache. Weights available on Hugging Face.
From GPU to Token: The 8-Layer Observability Stack for AI Infrastructure
🧠
LLMs
Content type:
Blog
jimmysong.io
·
1d
1 day ago
Actions for From GPU to Token: The 8-Layer Observability Stack for AI Infrastructure
Speculators v0.5.0: DFlash support and online training
🧠
LLMs
developers.redhat.com
·
6d
6 days ago
Actions for Speculators v0.5.0: DFlash support and online training
Less-relevant results
Ask HN: Is software engineering still a good career choice for new students?
🧠
LLMs
Content type:
Discussion
news.ycombinator.com
·
17h
17 hours ago
·
Hacker News
Actions for Ask HN: Is software engineering still a good career choice for new students?
HNSW vs LSH: How Elasticsearch hits 0.99 recall@10 at 15,000 QPS — and what it costs
🧠
LLMs
Content type:
Blog
elastic.co
·
1d
1 day ago
Actions for HNSW vs LSH: How Elasticsearch hits 0.99 recall@10 at 15,000 QPS — and what it costs
146th airhacks tv: Rust, Java 25, AI Agents, BCE, Web Components, zunit, zb
🧠
LLMs
Content type:
Blog
adambien.blog
·
12h
12 hours ago
Actions for 146th airhacks tv: Rust, Java 25, AI Agents, BCE, Web Components, zunit, zb
RKSC: Reasoning-Aware
KV
Cache
Sharing and Confident Early Exit for Multi-Step
LLM
Inference
🧠
LLMs
Content type:
Academic
arxiv.org
·
12h
12 hours ago
Actions for RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference
GGUF vs GPTQ vs AWQ: The Plain-English Guide to
LLM
Quantization
(and Which One to Pick)
🌐
Open Source AI
vettedconsumer.com
·
4d
4 days ago
·
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
High Bandwidth Flash | A New Memory for AI Data Centers and Edge Computing | Sandisk
🎛️
Fine-tuning
ncnonline.net
·
1d
1 day ago
Actions for High Bandwidth Flash | A New Memory for AI Data Centers and Edge Computing | Sandisk
The Bill Arrives: How to Manage Agentic AI Costs at Scale
🤖
AI Agents
Content type:
Blog
cockroachlabs.com
·
16h
16 hours ago
Actions for The Bill Arrives: How to Manage Agentic AI Costs at Scale
Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!
🌐
Open Source AI
gizchina.com
·
1d
1 day ago
Actions for Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!
MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better
🌐
Open Source AI
Content type:
News
Content type:
Blog
kaitchup.substack.com
·
4d
4 days ago
·
r/LocalLLaMA
Actions for MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better
Pruned YOLOv8 ONNX INT8 Fails: 3 Fixes That Work
🎛️
Fine-tuning
Content type:
Blog
Content type:
Discussion
tildalice.io
·
5d
5 days ago
Actions for Pruned YOLOv8 ONNX INT8 Fails: 3 Fixes That Work
MiMo-v2.5-Pro-UltraSpeed: 1T
model
with 1000 TPS
🎛️
Fine-tuning
Content type:
Blog
mimo.xiaomi.com
·
2d
2 days ago
·
Hacker News
,
r/LocalLLaMA
Actions for MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 TPS
Build a Medical Report Analyzer on Dedicated
Inference
with Python
🧠
LLMs
digitalocean.com
·
6d
6 days ago
Actions for Build a Medical Report Analyzer on Dedicated Inference with Python
« Page 1
·
Page 3 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help