Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
AI Engineering
🤖 AI Engineering
AI infrastructure, model serving, inference, MLOps
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
195
posts in
6.7
ms
harshuljain13/llm-inference-at-scale
: A Practitioner handbook for production
llm
serving
.
🧠
LLM Research
Content type:
Code
github.com
·
3d
3 days ago
·
Hacker News
Actions for harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.
lightmetal:
GPU
LLM
Inference
From a Single Java 25 JAR
🎮
GPU Programming
Content type:
Blog
adambien.blog
·
1d
1 day ago
Actions for lightmetal: GPU LLM Inference From a Single Java 25 JAR
DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
🎮
GPU Programming
Content type:
News
newsletter.semianalysis.com
·
21h
21 hours ago
·
Hacker News
Actions for DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
Architecturally Significant
MLOps
Guidelines for ML
Model
Integration and
Deployment
: a Gray Literature Review
🔩
ML Compilers
Content type:
Academic
arxiv.org
·
2d
2 days ago
Actions for Architecturally Significant MLOps Guidelines for ML Model Integration and Deployment: a Gray Literature Review
Token4Token — pay-per-token
inference
on Gnosis + Swarm
🔧
Backend Dev
t4t.eth.link
·
22h
22 hours ago
·
Hacker News
Actions for Token4Token — pay-per-token inference on Gnosis + Swarm
Running
LLM
Inference
on Kubernetes: What It Actually Takes
🔩
ML Compilers
Content type:
Blog
fairwinds.com
·
4d
4 days ago
Actions for Running LLM Inference on Kubernetes: What It Actually Takes
A system programmer’s guide to
LLM
inference
🎮
GPU Programming
Content type:
Blog
blog.xiangpeng.systems
·
2d
2 days ago
·
Hacker News
Actions for A system programmer’s guide to LLM inference
Ask HN: Is software
engineering
still a good career choice for new students?
🔧
Backend Dev
Content type:
Discussion
news.ycombinator.com
·
10h
10 hours ago
·
Hacker News
Actions for Ask HN: Is software engineering still a good career choice for new students?
LLM
Inference
Engineering
Room — Part 3: The Orchestration Layer
🧠
LLM Research
Content type:
Blog
vimal-dwarampudi.medium.com
·
6d
6 days ago
Actions for LLM Inference Engineering Room — Part 3: The Orchestration Layer
2x GH200 for
LLM
inference
, Part 2:
vLLM
, DeepSeek V4 Flash, and MTP
🎮
GPU Programming
Content type:
Blog
dnhkng.github.io
·
2d
2 days ago
Actions for 2x GH200 for LLM inference, Part 2: vLLM, DeepSeek V4 Flash, and MTP
Distributed multi-agent systems with Aspire and Microsoft Agent Framework
🔧
Backend Dev
Content type:
Blog
devblogs.microsoft.com
·
16h
16 hours ago
Actions for Distributed multi-agent systems with Aspire and Microsoft Agent Framework
PagedAttention vs Traditional KV Cache: How
vLLM
Reinvented
GPU
Memory for
LLM
Inference
🗄️
Database Internals
Content type:
Blog
medium.com
·
1d
1 day ago
Actions for PagedAttention vs Traditional KV Cache: How vLLM Reinvented GPU Memory for LLM Inference
The hidden bottleneck in
LLM
inference
and the impact on MLPerf benchmarking
🧠
LLM Research
edn.com
·
6d
6 days ago
Actions for The hidden bottleneck in LLM inference and the impact on MLPerf benchmarking
15 years of Software Center – A Look in the Mirror and over the Front Windshield
⚙️
Systems Programming
Content type:
Blog
metrics.blogg.gu.se
·
1h
1 hour ago
Actions for 15 years of Software Center – A Look in the Mirror and over the Front Windshield
From
GPU
to Token: The 8-Layer Observability Stack for
AI
Infrastructure
🎮
GPU Programming
Content type:
Blog
jimmysong.io
·
1d
1 day ago
Actions for From GPU to Token: The 8-Layer Observability Stack for AI Infrastructure
Autonomous
AI
worm uses local
models
to exploit networks and repair its own code
🛡️
AI Safety
4sysops.com
·
18h
18 hours ago
Actions for Autonomous AI worm uses local models to exploit networks and repair its own code
3-Part Series:
LLM
Latency
in Production (Part 1)
🖥️
OS Development
towardsai.net
·
6d
6 days ago
Actions for 3-Part Series: LLM Latency in Production (Part 1)
google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
🦀
Rust
huggingface.co
·
1d
1 day ago
·
r/LocalLLaMA
Actions for google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
Build a Medical Report Analyzer on Dedicated
Inference
with Python
🔩
ML Compilers
digitalocean.com
·
5d
5 days ago
Actions for Build a Medical Report Analyzer on Dedicated Inference with Python
Two Leaps to 1000 Tokens/s on a 1T-Parameter
Model
: On
Inference
Systems, Execution Boundaries, and Co-Design
⚙️
Hardware Architecture
Content type:
Blog
tilert.ai
·
1d
1 day ago
·
Hacker News
Actions for Two Leaps to 1000 Tokens/s on a 1T-Parameter Model: On Inference Systems, Execution Boundaries, and Co-Design
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help