Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Vllm
⚡ Vllm
Specific
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
111
posts in
6.8
ms
harshuljain13/llm-inference-at-scale
: A Practitioner handbook for production
llm
serving
.
🤖
LLM Inference
Content type:
Code
github.com
·
4d
4 days ago
·
Hacker News
Actions for harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.
PagedAttention
vs Traditional
KV
Cache
: How vLLM Reinvented GPU Memory for LLM Inference
🤖
LLM Inference
Content type:
Blog
medium.com
·
2d
2 days ago
Actions for PagedAttention vs Traditional KV Cache: How vLLM Reinvented GPU Memory for LLM Inference
RKSC: Reasoning-Aware
KV
Cache
Sharing and Confident Early Exit for Multi-Step
LLM
Inference
🤖
LLM Inference
Content type:
Academic
arxiv.org
·
20h
20 hours ago
Actions for RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference
Big Blue’s Redbook on Storage Scale
KV
Cache
management
🤖
LLM Inference
Content type:
News
blocksandfiles.com
·
1d
1 day ago
Actions for Big Blue’s Redbook on Storage Scale KV Cache management
Less-relevant results
How we fight GPU scarcity without compromise
🤖
LLM Inference
Content type:
Blog
equixly.com
·
5d
5 days ago
·
Hacker News
Actions for How we fight GPU scarcity without compromise
DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
🤖
LLM Inference
Content type:
News
newsletter.semianalysis.com
·
1d
1 day ago
·
Hacker News
Actions for DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
The Inference Alpha: Maximizing Frontier Models on AMD
🤖
LLM Inference
Content type:
Blog
digitalocean.com
·
10h
10 hours ago
Actions for The Inference Alpha: Maximizing Frontier Models on AMD
Anatomy of a
high-performance
EP kernel
🤖
LLM Inference
Content type:
Blog
fergusfinn.com
·
1d
1 day ago
·
Hacker News
Actions for Anatomy of a high-performance EP kernel
Youssof Altoukhi (@Youssofal_)
🤖
LLM Inference
xcancel.com
·
3d
3 days ago
·
r/LocalLLaMA
Actions for Youssof Altoukhi (@Youssofal_)
DiffusionGemma: The Developer Guide- Google Developers Blog
🤖
LLM Inference
Content type:
Blog
developers.googleblog.com
·
1d
1 day ago
·
r/LocalLLaMA
Actions for DiffusionGemma: The Developer Guide- Google Developers Blog
Nvidia DGX Spark GB10 – AI Models and Guide with
vLLM
and Autonomous Script
🤖
LLM Inference
Content type:
Code
github.com
·
5d
5 days ago
·
Hacker News
Actions for Nvidia DGX Spark GB10 – AI Models and Guide with vLLM and Autonomous Script
Machinic Psychopharmacology: Do LLMs Self-Medicate?
🤖
LLM
lesswrong.com
·
10h
10 hours ago
·
Hacker News
Actions for Machinic Psychopharmacology: Do LLMs Self-Medicate?
Alignment Collapse Under
KV
Cache
Quantization: Diagnosis and Mitigation
🤖
LLM Inference
Content type:
Academic
arxiv.org
·
20h
20 hours ago
Actions for Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation
Building & Benchmarking: LLMs on a 16GB Jetson Orin NX for Hermes Agent
🤖
LLM
Content type:
Blog
dnhkng.github.io
·
2d
2 days ago
Actions for Building & Benchmarking: LLMs on a 16GB Jetson Orin NX for Hermes Agent
The hidden bottleneck in
LLM
inference and the impact on MLPerf benchmarking
🤖
LLM Inference
edn.com
·
6d
6 days ago
Actions for The hidden bottleneck in LLM inference and the impact on MLPerf benchmarking
Massive AI Storage Demand Creates a New Memory Wall
🤖
LLM
Content type:
News
eetimes.com
·
10h
10 hours ago
Actions for Massive AI Storage Demand Creates a New Memory Wall
Running Qwen 35B MoE at 450k Context on a Single 32GB GPU
🤖
LLM Inference
local-llm.utop.workers.dev
·
3d
3 days ago
·
Hacker News
Actions for Running Qwen 35B MoE at 450k Context on a Single 32GB GPU
Show HN: Taliesin – bit-exact
KV-cache
restore, 21x faster, cross-GPU verified
🤖
LLM Inference
Content type:
Blog
medium.com
·
6d
6 days ago
·
Hacker News
Actions for Show HN: Taliesin – bit-exact KV-cache restore, 21x faster, cross-GPU verified
KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant
KV
cache
+ HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.
🤖
LLM Inference
Content type:
Code
github.com
·
8h
8 hours ago
·
Hacker News
Actions for KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.
GGUF vs GPTQ vs AWQ: The Plain-English Guide to
LLM
Quantization (and Which One to Pick)
🤖
LLM
vettedconsumer.com
·
4d
4 days ago
·
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help