Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
AI
🤖 AI
artificial intelligence, machine learning, LLM, generative AI
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
430
posts in
5.5
ms
harshuljain13/llm-inference-at-scale
: A Practitioner handbook for production
llm
serving.
💬
LLMs
Content type:
Code
github.com
·
4d
4 days ago
·
Hacker News
Actions for harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.
Report: GKE
Inference
Gateway delivers up to 92% faster
AI
responses
📰
AI News
Content type:
Blog
cloud.google.com
·
2d
2 days ago
·
Hacker News
Actions for Report: GKE Inference Gateway delivers up to 92% faster AI responses
RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step
LLM
Inference
💬
LLMs
Content type:
Academic
arxiv.org
·
21h
21 hours ago
Actions for RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference
Inferoa
AI
harness claimed 90% cache savings. We ran it and measured 97.8%
🤖
AI Agents
zozo123.github.io
·
15h
15 hours ago
·
Hacker News
Actions for Inferoa AI harness claimed 90% cache savings. We ran it and measured 97.8%
Why LLMs (still) lack taste
✨
Generative AI
beyondtheprior.com
·
2d
2 days ago
·
Hacker News
Actions for Why LLMs (still) lack taste
Using
Scikit-LLM
with Open-Source LLMs
💬
LLMs
machinelearningmastery.com
·
6d
6 days ago
Actions for Using Scikit-LLM with Open-Source LLMs
147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents,
AI
Rails, Saving Tokens
🤖
AI Agents
Content type:
Blog
adambien.blog
·
22h
22 hours ago
Actions for 147th airhacks tv: Local LLMs, LightMetal, ZSmith Agents, AI Rails, Saving Tokens
DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
💬
LLMs
Content type:
News
newsletter.semianalysis.com
·
1d
1 day ago
·
Hacker News
Actions for DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
Google open-sources speedy DiffusionGemma text diffusion model
✨
Generative AI
siliconangle.com
·
1h
1 hour ago
Actions for Google open-sources speedy DiffusionGemma text diffusion model
NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local
AI
📰
AI News
Content type:
Blog
blogs.nvidia.com
·
9h
9 hours ago
Actions for NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI
MLPerf and the rise of latency-aware
LLM
benchmarking
💬
LLMs
edn.com
·
5d
5 days ago
Actions for MLPerf and the rise of latency-aware LLM benchmarking
Token4Token — pay-per-token
inference
on Gnosis + Swarm
💬
LLMs
t4t.eth.link
·
1d
1 day ago
·
Hacker News
Actions for Token4Token — pay-per-token inference on Gnosis + Swarm
DiffusionGemma: 4x Faster Text
Generation
✨
Generative AI
Content type:
News
Content type:
Blog
blog.google
·
9h
9 hours ago
·
Hacker News
,
r/LocalLLaMA
,
r/singularity
Actions for DiffusionGemma: 4x Faster Text Generation
Apple WWDC On-Device
AI
Deep Dive - Google Docs
✨
Generative AI
gist.is
·
3h
3 hours ago
·
Hacker News
Actions for Apple WWDC On-Device AI Deep Dive - Google Docs
LeLab Is
Hugging
Face
’s New Browser-Based GUI for the LeRobot Ecosystem
📰
AI News
Content type:
News
hackster.io
·
1d
1 day ago
Actions for LeLab Is Hugging Face’s New Browser-Based GUI for the LeRobot Ecosystem
Build a Medical Report Analyzer on Dedicated
Inference
with Python
💬
LLMs
digitalocean.com
·
6d
6 days ago
Actions for Build a Medical Report Analyzer on Dedicated Inference with Python
AMD's Lemonade SDK For Local
AI
Adds NVIDIA CUDA Support
✨
Generative AI
phoronix.com
·
9h
9 hours ago
Actions for AMD's Lemonade SDK For Local AI Adds NVIDIA CUDA Support
Melanie Mitchell: What We Get Wrong About
AI
✨
Generative AI
yalereview.org
·
2d
2 days ago
·
Substack
,
Hacker News
,
Hacker News
Actions for Melanie Mitchell: What We Get Wrong About AI
Domain-Specific Small Language Models (Manning)
💬
LLMs
i-programmer.info
·
10h
10 hours ago
Actions for Domain-Specific Small Language Models (Manning)
Running
LLM
Inference
on Kubernetes: What It Actually Takes
💬
LLMs
Content type:
Blog
fairwinds.com
·
5d
5 days ago
Actions for Running LLM Inference on Kubernetes: What It Actually Takes
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help