Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
LLM Serving
🚀 LLM Serving
Specific
LLM inference, vLLM, model deployment, inference optimization
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
254
posts in
8.3
ms
Nvidia
DGX Spark GB10 – AI
Models
and Guide with
vLLM
and Autonomous Script
🖥️
GPU Computing
Content type:
Code
github.com
·
4d
4 days ago
·
Hacker News
Actions for Nvidia DGX Spark GB10 – AI Models and Guide with vLLM and Autonomous Script
Inferoa
AI harness claimed 90%
cache
savings. We ran it and measured 97.8%
☁️
GCP
zozo123.github.io
·
8h
8 hours ago
·
Hacker News
Actions for Inferoa AI harness claimed 90% cache savings. We ran it and measured 97.8%
Breaking the Ice: Analyzing Cold Start
Latency
in
vLLM
⚙️
ML Infrastructure
Content type:
Academic
arxiv.org
·
2d
2 days ago
Actions for Breaking the Ice: Analyzing Cold Start Latency in vLLM
I've tested so many desktop AI tools, but Hermes with
Ollama
is my new favorite - here's why
🤝
AI-Assisted Coding
Content type:
News
Content type:
Tutorial
zdnet.com
·
4h
4 hours ago
Actions for I've tested so many desktop AI tools, but Hermes with Ollama is my new favorite - here's why
Ollama
0.30 delivers faster
NVIDIA
GPU performance and wider hardware support
🖥️
GPU Computing
alternativeto.net
·
2d
2 days ago
Actions for Ollama 0.30 delivers faster NVIDIA GPU performance and wider hardware support
A visionary legacy: Andy Brown
🕸️
Distributed Systems
uk.themedialeader.com
·
14h
14 hours ago
Actions for A visionary legacy: Andy Brown
Speculators
v0.5.0: DFlash support and online training
⚙️
ML Infrastructure
developers.redhat.com
·
6d
6 days ago
Actions for Speculators v0.5.0: DFlash support and online training
Qwen 3.6 27B AutoRound GGUF, need your feedback
⚙️
ML Infrastructure
huggingface.co
·
23h
23 hours ago
·
r/LocalLLaMA
Actions for Qwen 3.6 27B AutoRound GGUF, need your feedback
Fixing a stuck
Ollama
runner and building a GPU watchdog
🖥️
GPU Computing
patrickmccanna.net
·
1d
1 day ago
·
Hacker News
Actions for Fixing a stuck Ollama runner and building a GPU watchdog
Improved performance and
model
support with GGUF
⚙️
ML Infrastructure
Content type:
Blog
ollama.com
·
5d
5 days ago
Actions for Improved performance and model support with GGUF
The economics of
speculative
decoding
🖥️
GPU Computing
Content type:
Blog
fergusfinn.com
·
2d
2 days ago
·
Hacker News
Actions for The economics of speculative decoding
NVIDIA
Accelerates Google DeepMind’s DiffusionGemma for Local AI
🖥️
GPU Computing
Content type:
Blog
blogs.nvidia.com
·
2h
2 hours ago
Actions for NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI
PagedAttention vs Traditional
KV
Cache
: How
vLLM
Reinvented GPU Memory for LLM Inference
🖥️
GPU Computing
Content type:
Blog
medium.com
·
2d
2 days ago
Actions for PagedAttention vs Traditional KV Cache: How vLLM Reinvented GPU Memory for LLM Inference
Using
Scikit-LLM
with Open-Source LLMs
⚙️
ML Infrastructure
machinelearningmastery.com
·
6d
6 days ago
Actions for Using Scikit-LLM with Open-Source LLMs
Less-relevant results
AMD's Lemonade SDK For Local AI Adds
NVIDIA
CUDA Support
🖥️
GPU Computing
phoronix.com
·
2h
2 hours ago
Actions for AMD's Lemonade SDK For Local AI Adds NVIDIA CUDA Support
Tales of an
Ollama
Honeypot (Part 3): More Traffic, More Findings
🌐
Cilium
posts.inthecyber.com
·
2d
2 days ago
Actions for Tales of an Ollama Honeypot (Part 3): More Traffic, More Findings
Gemma 4 QAT
models
:
Optimizing
model compression for mobile and laptop efficiency
⚙️
ML Infrastructure
Content type:
News
Content type:
Blog
blog.google
·
5d
5 days ago
·
Hacker News
Actions for Gemma 4 QAT models: Optimizing model compression for mobile and laptop efficiency
DiffusionGemma: The Developer Guide
💾
AI Hardware
Content type:
Blog
developers.googleblog.com
·
18h
18 hours ago
Actions for DiffusionGemma: The Developer Guide
DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
🖥️
GPU Computing
Content type:
News
newsletter.semianalysis.com
·
1d
1 day ago
·
Hacker News
Actions for DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
LLM
Inference
Engineering Room — Part 3: The Orchestration Layer
⚙️
ML Infrastructure
Content type:
Blog
vimal-dwarampudi.medium.com
·
6d
6 days ago
Actions for LLM Inference Engineering Room — Part 3: The Orchestration Layer
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help