Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
LLM Inference
⚡ LLM Inference
Specific
inference serving, vLLM, TensorRT, model serving, token generation
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
283
posts in
7.8
ms
Nvidia DGX Spark GB10 – AI
Models
and Guide with
vLLM
and Autonomous Script
🤖
LLMs
Content type:
Code
github.com
·
6d
6 days ago
·
Hacker News
Actions for Nvidia DGX Spark GB10 – AI Models and Guide with vLLM and Autonomous Script
Inferoa
AI harness claimed 90% cache savings. We ran it and measured 97.8%
🤖
LLMs
zozo123.github.io
·
1d
1 day ago
·
Hacker News
Actions for Inferoa AI harness claimed 90% cache savings. We ran it and measured 97.8%
How ERGO Hestia reduced time-to-market with Lakebase and Mosaic AI
Model
Serving
📈
Performance Engineering
Content type:
Blog
databricks.com
·
12h
12 hours ago
Actions for How ERGO Hestia reduced time-to-market with Lakebase and Mosaic AI Model Serving
UniSVQ: 2-bit Unified Scalar-Vector
Quantization
✍️
Prompt Engineering
Content type:
Academic
arxiv.org
·
2d
2 days ago
Actions for UniSVQ: 2-bit Unified Scalar-Vector Quantization
Google's DiffusionGemma
generates
256
tokens
in parallel and self-corrects as it goes
🤖
LLMs
venturebeat.com
·
16h
16 hours ago
Actions for Google's DiffusionGemma generates 256 tokens in parallel and self-corrects as it goes
Gemma 4 QAT
models
: Optimizing model compression for mobile and laptop efficiency
🤖
LLMs
Content type:
News
Content type:
Blog
blog.google
·
6d
6 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
How Does Attention Work in LLMs? 2026 Deep Dive
✍️
Prompt Engineering
Content type:
Blog
medium.com
·
5h
5 hours ago
Actions for How Does Attention Work in LLMs? 2026 Deep Dive
Qwen 3.6 27B AutoRound GGUF, need your feedback
🤖
LLMs
huggingface.co
·
2d
2 days ago
·
r/LocalLLaMA
Actions for Qwen 3.6 27B AutoRound GGUF, need your feedback
PagedAttention
vs Traditional KV Cache: How
vLLM
Reinvented GPU Memory for
LLM
Inference
🤖
LLMs
Content type:
Blog
medium.com
·
3d
3 days ago
Actions for PagedAttention vs Traditional KV Cache: How vLLM Reinvented GPU Memory for LLM Inference
A visionary legacy: Andy Brown
📊
OLAP
uk.themedialeader.com
·
2d
2 days ago
Actions for A visionary legacy: Andy Brown
Less-relevant results
Friday Five — June 12, 2026
🤖
LLMs
redhat.com
·
8h
8 hours ago
Actions for Friday Five — June 12, 2026
Pruned YOLOv8 ONNX INT8 Fails: 3 Fixes That Work
📈
Performance Engineering
Content type:
Blog
Content type:
Discussion
tildalice.io
·
6d
6 days ago
Actions for Pruned YOLOv8 ONNX INT8 Fails: 3 Fixes That Work
DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
🤖
LLMs
Content type:
News
newsletter.semianalysis.com
·
2d
2 days ago
·
Hacker News
Actions for DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
Stop Treating Your
Models
Like Microservices
🔭
Observability
cloudnativenow.com
·
14h
14 hours ago
Actions for Stop Treating Your Models Like Microservices
The latest Gemma 4
models
use a training trick to slash their on-device memory footprint
🤖
LLMs
androidauthority.com
·
6d
6 days ago
Actions for The latest Gemma 4 models use a training trick to slash their on-device memory footprint
TurboQuant in PostgreSQL
🗄️
Databases
Content type:
Blog
blog.mayflower.de
·
23h
23 hours ago
Actions for TurboQuant in PostgreSQL
NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI
🤖
LLMs
Content type:
Blog
blogs.nvidia.com
·
1d
1 day ago
Actions for NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI
Unsloth Gemma 4 QAT
🎮
GPU Computing
unsloth.ai
·
6d
6 days ago
Actions for Unsloth Gemma 4 QAT
Ultrafast machine learning on FPGAs via Kolmogorov-Arnold Networks
📈
Performance Engineering
aarushgupta.io
·
2d
2 days ago
·
Lobsters
,
Hacker News
Actions for Ultrafast machine learning on FPGAs via Kolmogorov-Arnold Networks
massimo92/spark: CLI tool for
serving
LLMs with
vLLM
on NVIDIA DGX Spark. One file, zero friction.
🤖
LLMs
Content type:
Code
github.com
·
12h
12 hours ago
·
Hacker News
Actions for massimo92/spark: CLI tool for serving LLMs with vLLM on NVIDIA DGX Spark. One file, zero friction.
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help