Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
Inference Cost
💰 Inference Cost
GPU cost, inference pricing, cost per token, LLM economics
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
313
posts in
9.0
ms
harshuljain13/llm-inference-at-scale
: A Practitioner handbook for production
llm
serving.
💾
KV Cache
Content type:
Code
github.com
·
4d
4 days ago
·
Hacker News
Actions for harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.
From
GPU
to
Token
: The 8-Layer Observability Stack for AI Infrastructure
📡
OpenTelemetry
Content type:
Blog
jimmysong.io
·
1d
1 day ago
Actions for From GPU to Token: The 8-Layer Observability Stack for AI Infrastructure
Alignment Collapse Under KV Cache
Quantization
: Diagnosis and Mitigation
🧠
Inference Engineering
Content type:
Academic
arxiv.org
·
13h
13 hours ago
Actions for Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation
Qwen 3.6 27B AutoRound GGUF, need your feedback
🗜️
Quantization
huggingface.co
·
22h
22 hours ago
·
r/LocalLLaMA
Actions for Qwen 3.6 27B AutoRound GGUF, need your feedback
lightmetal:
GPU
LLM
Inference
From a Single Java 25 JAR
🗜️
Quantization
Content type:
Blog
adambien.blog
·
1d
1 day ago
Actions for lightmetal: GPU LLM Inference From a Single Java 25 JAR
The hidden bottleneck in
LLM
inference
and the impact on MLPerf benchmarking
🧠
Inference Engineering
edn.com
·
6d
6 days ago
Actions for The hidden bottleneck in LLM inference and the impact on MLPerf benchmarking
Anatomy of a high-performance EP kernel
🧠
Inference Engineering
Content type:
Blog
fergusfinn.com
·
17h
17 hours ago
·
Hacker News
Actions for Anatomy of a high-performance EP kernel
A system programmer’s guide to
LLM
inference
🧠
Inference Engineering
Content type:
Blog
blog.xiangpeng.systems
·
2d
2 days ago
·
Hacker News
Actions for A system programmer’s guide to LLM inference
The
Inference
Alpha: Maximizing Frontier Models on AMD
🧠
Inference Engineering
Content type:
Blog
digitalocean.com
·
2h
2 hours ago
Actions for The Inference Alpha: Maximizing Frontier Models on AMD
Train Models Faster with JAX and MaxText Using NVFP4 on NVIDIA Blackwell
🔢
FP8 Training
Content type:
News
Content type:
Blog
developer.nvidia.com
·
1d
1 day ago
Actions for Train Models Faster with JAX and MaxText Using NVFP4 on NVIDIA Blackwell
How we fight
GPU
scarcity without compromise
💾
KV Cache
Content type:
Blog
equixly.com
·
5d
5 days ago
·
Hacker News
Actions for How we fight GPU scarcity without compromise
Ultrafast machine learning on FPGAs via Kolmogorov-Arnold Networks
🗜️
Quantization
aarushgupta.io
·
22h
22 hours ago
·
Lobsters
,
Hacker News
Actions for Ultrafast machine learning on FPGAs via Kolmogorov-Arnold Networks
2x GH200 for
LLM
inference
, Part 2: vLLM, DeepSeek V4 Flash, and MTP
🧠
Inference Engineering
Content type:
Blog
dnhkng.github.io
·
2d
2 days ago
Actions for 2x GH200 for LLM inference, Part 2: vLLM, DeepSeek V4 Flash, and MTP
GGUF vs GPTQ vs AWQ: The Plain-English Guide to
LLM
Quantization
(and Which One to Pick)
🗜️
Quantization
vettedconsumer.com
·
4d
4 days ago
·
Hacker News
Actions for GGUF vs GPTQ vs AWQ: The Plain-English Guide to LLM Quantization (and Which One to Pick)
PagedAttention vs Traditional KV Cache: How vLLM Reinvented
GPU
Memory for
LLM
Inference
⏱️
Prefill Decoding
Content type:
Blog
medium.com
·
1d
1 day ago
Actions for PagedAttention vs Traditional KV Cache: How vLLM Reinvented GPU Memory for LLM Inference
GPU
Servers for Best Performance
🎮
GPU Computing
leaseweb.com
·
6d
6 days ago
·
DEV
Actions for GPU Servers for Best Performance
HNSW vs LSH: How Elasticsearch hits 0.99 recall@10 at 15,000 QPS — and what it
costs
🧠
HBM Bandwidth
Content type:
Blog
elastic.co
·
1d
1 day ago
Actions for HNSW vs LSH: How Elasticsearch hits 0.99 recall@10 at 15,000 QPS — and what it costs
The
Bill
Arrives: How to Manage Agentic AI
Costs
at
Scale
⚙️
MLOps
Content type:
Blog
cockroachlabs.com
·
17h
17 hours ago
Actions for The Bill Arrives: How to Manage Agentic AI Costs at Scale
Trainable Smooth-Rotation Transforms with Learned Channel Scales for
LLM
Quantization
🗜️
Quantization
Content type:
Academic
arxiv.org
·
13h
13 hours ago
Actions for Trainable Smooth-Rotation Transforms with Learned Channel Scales for LLM Quantization
A UK startup says it can cut data centre network power by 81% by replacing every electrical switch with light
🔴
ROCm
Content type:
News
thenextweb.com
·
2d
2 days ago
Actions for A UK startup says it can cut data centre network power by 81% by replacing every electrical switch with light
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help