Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
LLMs
🧠 LLMs
Specific
large language models, GPT, Claude, transformer, foundation models
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
221
posts in
7.9
ms
harshuljain13/llm-inference-at-scale
: A Practitioner handbook for production
llm
serving.
⚙️
MLOps
Content type:
Code
github.com
·
3d
3 days ago
·
Hacker News
Actions for harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.
Report: GKE
Inference
Gateway delivers up to 92% faster AI responses
🏗️
Infrastructure
Content type:
Blog
cloud.google.com
·
1d
1 day ago
·
Hacker News
Actions for Report: GKE Inference Gateway delivers up to 92% faster AI responses
DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
⚙️
MLOps
Content type:
News
newsletter.semianalysis.com
·
21h
21 hours ago
·
Hacker News
Actions for DeepSeekV4 1.6T Day 0 to Day 43 Performance Over Time - Huawei, GB300 NVL72, MI355X, B200
Comprehensive evaluation of
LLM
capabilities for interpretation and analysis of genome-scale metabolic
models
in metabolic
engineering
⚙️
MLOps
Content type:
Academic
biorxiv.org
·
1d
1 day ago
Actions for Comprehensive evaluation of LLM capabilities for interpretation and analysis of genome-scale metabolic models in metabolic engineering
Token4Token — pay-per-token
inference
on Gnosis + Swarm
📡
Edge Computing
t4t.eth.link
·
22h
22 hours ago
·
Hacker News
Actions for Token4Token — pay-per-token inference on Gnosis + Swarm
Using
Scikit-LLM
with Open-Source LLMs
⚙️
MLOps
machinelearningmastery.com
·
5d
5 days ago
Actions for Using Scikit-LLM with Open-Source LLMs
How J.A.R.V.I.S. Became the Smartest Mind on Earth — What is an
LLM
?
🌐
Networking
Content type:
Blog
medium.com
·
2d
2 days ago
Actions for How J.A.R.V.I.S. Became the Smartest Mind on Earth — What is an LLM?
OpenCV 5 release - New DNN
engine
with enhanced ONNX and
LLM/VLM
support, Intel, Arm, and RISC-V hardware optimizations - CNX Software
👁️
Computer Vision
Content type:
News
cnx-software.com
·
5h
5 hours ago
Actions for OpenCV 5 release - New DNN engine with enhanced ONNX and LLM/VLM support, Intel, Arm, and RISC-V hardware optimizations - CNX Software
SigmaScale:
LLM
Compression with SVD-based Low-Rank Decomposition and Learned Scaling Matrices
🗄️
Vector Databases
Content type:
Academic
arxiv.org
·
2d
2 days ago
Actions for SigmaScale: LLM Compression with SVD-based Low-Rank Decomposition and Learned Scaling Matrices
Build a Medical Report Analyzer on Dedicated
Inference
with Python
⚙️
MLOps
digitalocean.com
·
5d
5 days ago
Actions for Build a Medical Report Analyzer on Dedicated Inference with Python
2x GH200 for
LLM
inference
, Part 2:
vLLM
, DeepSeek V4 Flash, and MTP
🐧
Linux
Content type:
Blog
dnhkng.github.io
·
2d
2 days ago
Actions for 2x GH200 for LLM inference, Part 2: vLLM, DeepSeek V4 Flash, and MTP
How we fight GPU scarcity without compromise
📡
Edge Computing
Content type:
Blog
equixly.com
·
4d
4 days ago
·
Hacker News
Actions for How we fight GPU scarcity without compromise
What's in the Box? A Field Guide to AI
Models
⚙️
MLOps
Content type:
Blog
iankduncan.com
·
1d
1 day ago
Actions for What's in the Box? A Field Guide to AI Models
LLM
Inference
Engineering
Room — Part 3: The Orchestration Layer
⚙️
MLOps
Content type:
Blog
vimal-dwarampudi.medium.com
·
6d
6 days ago
Actions for LLM Inference Engineering Room — Part 3: The Orchestration Layer
google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
🏗️
Infrastructure
huggingface.co
·
1d
1 day ago
·
r/LocalLLaMA
Actions for google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
What Are Tokens in
LLMs
?
⚙️
MLOps
Content type:
Blog
bearisland.dev
·
3d
3 days ago
·
Hacker News
Actions for What Are Tokens in LLMs?
Train
Models
Faster with JAX and MaxText Using NVFP4 on NVIDIA Blackwell
⚙️
MLOps
Content type:
News
Content type:
Blog
developer.nvidia.com
·
1d
1 day ago
Actions for Train Models Faster with JAX and MaxText Using NVFP4 on NVIDIA Blackwell
Location: Göttingen, Germany Remote: Yes (preferred; hybrid also
fine
) Willing t...
🤖
AI
Content type:
Discussion
news.ycombinator.com
·
6d
6 days ago
·
Hacker News
Actions for Location: Göttingen, Germany Remote: Yes (preferred; hybrid also fine) Willing t...
Running
LLM
Inference
on Kubernetes: What It Actually Takes
🏗️
Infrastructure
Content type:
Blog
fairwinds.com
·
4d
4 days ago
Actions for Running LLM Inference on Kubernetes: What It Actually Takes
PagedAttention vs Traditional KV Cache: How
vLLM
Reinvented GPU Memory for
LLM
Inference
📡
Edge Computing
Content type:
Blog
medium.com
·
1d
1 day ago
Actions for PagedAttention vs Traditional KV Cache: How vLLM Reinvented GPU Memory for LLM Inference
Page 2 »
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help