Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
AI Infrastructure
🏗️ AI Infrastructure
Model Serving, GPU Clusters, Inference Optimization, MLOps
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
318
posts in
18.2
ms
From
GPU
to Token: The 8-Layer Observability Stack for
AI
Infrastructure
⚡
Hardware Acceleration
Content type:
Blog
jimmysong.io
·
1d
1 day ago
Actions for From GPU to Token: The 8-Layer Observability Stack for AI Infrastructure
harshuljain13/llm-inference-at-scale
: A Practitioner handbook for production
llm
serving
.
🤖
AI Inference
Content type:
Code
github.com
·
4d
4 days ago
·
Hacker News
Actions for harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.
AMD's Lemonade SDK For Local
AI
Adds NVIDIA
CUDA
Support
⚡
Hardware Acceleration
phoronix.com
·
1h
1 hour ago
Actions for AMD's Lemonade SDK For Local AI Adds NVIDIA CUDA Support
Inferoa
AI
harness claimed 90% cache savings. We ran it and measured 97.8%
🤖
AI Inference
zozo123.github.io
·
7h
7 hours ago
·
Hacker News
Actions for Inferoa AI harness claimed 90% cache savings. We ran it and measured 97.8%
Architecturally Significant
MLOps
Guidelines for ML
Model
Integration and Deployment: a Gray Literature Review
🚀
MLOps
Content type:
Academic
arxiv.org
·
2d
2 days ago
Actions for Architecturally Significant MLOps Guidelines for ML Model Integration and Deployment: a Gray Literature Review
Running
LLM
Inference
on
Kubernetes
: What It Actually Takes
🧠
AI
Content type:
Blog
fairwinds.com
·
5d
5 days ago
Actions for Running LLM Inference on Kubernetes: What It Actually Takes
DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
🤖
AI Inference
Content type:
News
newsletter.semianalysis.com
·
1d
1 day ago
·
Hacker News
Actions for DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
KJLdefeated/RL.cu
: RLVR training for
LLM
in CUDA/C++
🔥
PyTorch
Content type:
Code
github.com
·
3d
3 days ago
·
Hacker News
Actions for KJLdefeated/RL.cu: RLVR training for LLM in CUDA/C++
Breaking free of a single datacenter: Practical geo-distributed
AI
operations with the k0smos platforms
☁️
Cloud Computing
Content type:
Blog
cncf.io
·
2d
2 days ago
Actions for Breaking free of a single datacenter: Practical geo-distributed AI operations with the k0smos platforms
NVIDIA Nsight Compute
⚡
Hardware Acceleration
developer.nvidia.com
·
6d
6 days ago
Actions for NVIDIA Nsight Compute
Cadence and Samsung Foundry Expand 2nm & 3D-IC Collaboration For
AI
Infrastructure
Development
⚡
Hardware Acceleration
pokde.net
·
4d
4 days ago
Actions for Cadence and Samsung Foundry Expand 2nm & 3D-IC Collaboration For AI Infrastructure Development
Speculators v0.5.0: DFlash support and online training
🤖
AI Inference
developers.redhat.com
·
6d
6 days ago
Actions for Speculators v0.5.0: DFlash support and online training
AgentCompile: An
LLM-Guided
Compiler for Direct
CUDA
Inference
🔥
PyTorch
Content type:
Academic
arxiv.org
·
1d
1 day ago
Actions for AgentCompile: An LLM-Guided Compiler for Direct CUDA Inference
Nvidia DGX Spark GB10 –
AI
Models
and Guide with
vLLM
and Autonomous Script
🤖
AI Inference
Content type:
Code
github.com
·
4d
4 days ago
·
Hacker News
Actions for Nvidia DGX Spark GB10 – AI Models and Guide with vLLM and Autonomous Script
huawei-csl/KVarN: KVarN is a native
vLLM
KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.
💻
Local LLMs
Content type:
Code
github.com
·
6d
6 days ago
·
Hacker News
Actions for huawei-csl/KVarN: KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.
Breaking the Ice: Analyzing Cold Start Latency in
vLLM
🤖
AI Inference
Content type:
Academic
arxiv.org
·
2d
2 days ago
Actions for Breaking the Ice: Analyzing Cold Start Latency in vLLM
fix(gateway): fail closed for unknown
model
auth · openclaw/openclaw@85343ea
🤖
AI Inference
Content type:
Code
github.com
·
5d
5 days ago
Actions for fix(gateway): fail closed for unknown model auth · openclaw/openclaw@85343ea
CUDA-Oxide
0.2 Brings Early Improvements To Pure Rust
CUDA
Kernels
⚡
Hardware Acceleration
phoronix.com
·
5d
5 days ago
Actions for CUDA-Oxide 0.2 Brings Early Improvements To Pure Rust CUDA Kernels
APEX4: Efficient Pure W4A4
LLM
Inference
via Intra-SM Compute Rebalancing
🔥
Burn
Content type:
Academic
arxiv.org
·
1d
1 day ago
Actions for APEX4: Efficient Pure W4A4 LLM Inference via Intra-SM Compute Rebalancing
RedKnot: Efficient Long-Context
LLM
Serving
with Head-Aware KV Reuse and SegPagedAttention
🤖
AI Inference
Content type:
Academic
arxiv.org
·
5d
5 days ago
Actions for RedKnot: Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help