Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
vLLM
⚡ vLLM
Specific
vLLM inference, PagedAttention, LLM serving, throughput inference
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
74
posts in
10.1
ms
PagedAttention
vs Traditional
KV
Cache
: How vLLM Reinvented GPU Memory for LLM Inference
🧠
KV Cache
Content type:
Blog
medium.com
·
2d
2 days ago
Actions for PagedAttention vs Traditional KV Cache: How vLLM Reinvented GPU Memory for LLM Inference
harshuljain13/llm-inference-at-scale
: A Practitioner handbook for production
llm
serving
.
🧠
KV Cache
Content type:
Code
github.com
·
4d
4 days ago
·
Hacker News
Actions for harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.
Inferoa
AI harness claimed 90%
cache
savings. We ran it and measured 97.8%
🧠
KV Cache
zozo123.github.io
·
19h
19 hours ago
·
Hacker News
Actions for Inferoa AI harness claimed 90% cache savings. We ran it and measured 97.8%
RKSC: Reasoning-Aware
KV
Cache
Sharing and Confident Early Exit for Multi-Step
LLM
Inference
🧠
KV Cache
Content type:
Academic
arxiv.org
·
1d
1 day ago
Actions for RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference
How we fight GPU scarcity without compromise
🧠
KV Cache
Content type:
Blog
equixly.com
·
5d
5 days ago
·
Hacker News
Actions for How we fight GPU scarcity without compromise
DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
🧠
KV Cache
Content type:
News
newsletter.semianalysis.com
·
1d
1 day ago
·
Hacker News
Actions for DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
Less-relevant results
NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI
⚡
LLM Inference
Content type:
Blog
blogs.nvidia.com
·
13h
13 hours ago
Actions for NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI
AMD's Lemonade SDK For Local AI Adds NVIDIA CUDA Support
🧠
KV Cache
phoronix.com
·
13h
13 hours ago
·
r/artificial
Actions for AMD's Lemonade SDK For Local AI Adds NVIDIA CUDA Support
google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
🧠
KV Cache
huggingface.co
·
2d
2 days ago
·
r/LocalLLaMA
Actions for google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
2x GH200 for
LLM
inference
, Part 2:
vLLM
, DeepSeek V4 Flash, and MTP
⚡
LLM Inference
Content type:
Blog
dnhkng.github.io
·
3d
3 days ago
Actions for 2x GH200 for LLM inference, Part 2: vLLM, DeepSeek V4 Flash, and MTP
DiffusionGemma: The Developer Guide- Google Developers
Blog
🧠
KV Cache
Content type:
Blog
developers.googleblog.com
·
1d
1 day ago
·
r/LocalLLaMA
Actions for DiffusionGemma: The Developer Guide- Google Developers Blog
How to Run Gemma 4 12B Locally - The Best AI For Consumer Laptops
🧠
KV Cache
Content type:
Video
youtube.com
·
6d
6 days ago
Actions for How to Run Gemma 4 12B Locally - The Best AI For Consumer Laptops
DiffusionGemma: 4x Faster Text Generation
🧠
KV Cache
Content type:
News
Content type:
Blog
blog.google
·
14h
14 hours ago
·
Hacker News
,
r/LocalLLaMA
,
r/singularity
Actions for DiffusionGemma: 4x Faster Text Generation
Token4Token — pay-per-token
inference
on Gnosis + Swarm
🧠
KV Cache
t4t.eth.link
·
1d
1 day ago
·
Hacker News
Actions for Token4Token — pay-per-token inference on Gnosis + Swarm
Where to Host Your Open-Source Model (Under 10B Parameters)
🧠
KV Cache
digitalocean.com
·
6d
6 days ago
Actions for Where to Host Your Open-Source Model (Under 10B Parameters)
Youssof Altoukhi (@Youssofal_)
🧠
KV Cache
xcancel.com
·
3d
3 days ago
·
r/LocalLLaMA
Actions for Youssof Altoukhi (@Youssofal_)
AI
Serving
Platform That Adapts to Your Model
⚡
LLM Inference
Content type:
Blog
databricks.com
·
14h
14 hours ago
Actions for AI Serving Platform That Adapts to Your Model
Machinic Psychopharmacology: Do LLMs Self-Medicate?
🧠
KV Cache
lesswrong.com
·
15h
15 hours ago
·
Hacker News
Actions for Machinic Psychopharmacology: Do LLMs Self-Medicate?
Running
LLM
Inference
on Kubernetes: What It Actually Takes
🧠
KV Cache
Content type:
Blog
fairwinds.com
·
5d
5 days ago
Actions for Running LLM Inference on Kubernetes: What It Actually Takes
MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better
⚡
LLM Inference
Content type:
News
Content type:
Blog
kaitchup.substack.com
·
5d
5 days ago
·
r/LocalLLaMA
Actions for MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help