Skip to main content
Scour
Browse
Getting Started
Login
Sign Up
You are offline. Trying to reconnect...
Copied to clipboard
Unable to share or copy to clipboard
LLM Serving
🚀 LLM Serving
Specific
LLM inference, vLLM, model deployment, inference optimization
Filter Results
Timeframe
Fresh
Past Hour
Today
This Week
This Month
Feeds to Scour
Subscribed
All
Scoured
256
posts in
8.8
ms
How I benchmarked a 100% local RAG pipeline to 9/9 (zero API keys)
⚙️
ML Infrastructure
buy.polar.sh
·
2d
2 days ago
·
DEV
Actions for How I benchmarked a 100% local RAG pipeline to 9/9 (zero API keys)
Alignment Collapse Under
KV
Cache
Quantization
: Diagnosis and Mitigation
🔀
Model Parallelism
Content type:
Academic
arxiv.org
·
17h
17 hours ago
Actions for Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation
How we fight GPU scarcity without compromise
🔀
Model Parallelism
Content type:
Blog
equixly.com
·
5d
5 days ago
·
Hacker News
Actions for How we fight GPU scarcity without compromise
Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good
🤝
AI-Assisted Coding
Content type:
Blog
towardsai.net
·
2d
2 days ago
Actions for Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good
DiffusionGemma: 4x Faster
Text
Generation
💾
AI Hardware
Content type:
News
Content type:
Blog
blog.google
·
5h
5 hours ago
·
Hacker News
,
r/LocalLLaMA
,
r/singularity
Actions for DiffusionGemma: 4x Faster Text Generation
Making LLMs faster and more efficient across multiple languages
⚙️
ML Infrastructure
techxplore.com
·
6d
6 days ago
Actions for Making LLMs faster and more efficient across multiple languages
"AI" Is Eating Platform Monopolist Free Cash Flow, Not the World: CHART OF THE DAY
🤝
AI-Assisted Coding
Content type:
News
Content type:
Blog
braddelong.substack.com
·
2d
2 days ago
·
Substack
Actions for "AI" Is Eating Platform Monopolist Free Cash Flow, Not the World: CHART OF THE DAY
harshuljain13/llm-inference-at-scale
: A Practitioner handbook for production
llm
serving
.
💾
AI Hardware
Content type:
Code
github.com
·
4d
4 days ago
·
Hacker News
Actions for harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.
A system programmer’s guide to
LLM
inference
🖥️
GPU Computing
Content type:
Blog
blog.xiangpeng.systems
·
2d
2 days ago
·
Hacker News
Actions for A system programmer’s guide to LLM inference
BeeLlama.cpp DFlash on Strix Halo: 2.7x Gemma 31B, But MTP Is Still Faster
🖥️
GPU Computing
sleepingrobots.com
·
3d
3 days ago
Actions for BeeLlama.cpp DFlash on Strix Halo: 2.7x Gemma 31B, But MTP Is Still Faster
WWDC 2026: Foundation
Models
(& Anarlog)
🛠️
Developer Tooling
skushagra.com
·
1d
1 day ago
Actions for WWDC 2026: Foundation Models (& Anarlog)
Where to Host Your Open-Source
Model
(Under 10B Parameters)
🖥️
GPU Computing
digitalocean.com
·
6d
6 days ago
Actions for Where to Host Your Open-Source Model (Under 10B Parameters)
3x Faster Search: Parallel Test-Time Scaling with Instructed-Retriever-1
⚙️
ML Infrastructure
Content type:
Blog
databricks.com
·
6d
6 days ago
Actions for 3x Faster Search: Parallel Test-Time Scaling with Instructed-Retriever-1
google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
⚙️
ML Infrastructure
huggingface.co
·
2d
2 days ago
·
r/LocalLLaMA
Actions for google/gemma-4-31B-it · fix: chat template — null handling, reasoning preservation, turn-tag balance, input validation
local AI agents for Cursor with pre-tuned marketplace/commu
🤝
AI-Assisted Coding
locaible.com
·
8h
8 hours ago
·
Hacker News
Actions for local AI agents for Cursor with pre-tuned marketplace/commu
Creating ADK Agent using locally running Gemma 4
🖥️
GPU Computing
Content type:
Blog
medium.com
·
3d
3 days ago
Actions for Creating ADK Agent using locally running Gemma 4
fix(memory-core): filter stale recall entries in REM harness preview · openclaw/openclaw@92418fc
☁️
GCP
Content type:
Code
github.com
·
16h
16 hours ago
Actions for fix(memory-core): filter stale recall entries in REM harness preview · openclaw/openclaw@92418fc
Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB
⚙️
ML Infrastructure
Content type:
Blog
ziraph.com
·
5d
5 days ago
·
Hacker News
Actions for Apples to Apples: MLX vs. Llama.cpp for Gemma 4 12B on an M1 16GB
Clairvoyant: Predictive SJF Scheduling to Mitigate Head-of-Line Blocking in Serial
LLM
Backends
📋
Kueue
Content type:
Academic
arxiv.org
·
2d
2 days ago
Actions for Clairvoyant: Predictive SJF Scheduling to Mitigate Head-of-Line Blocking in Serial LLM Backends
How to Measure Time To First Token (TTFT) in AI Systems
🤝
AI-Assisted Coding
qainsights.com
·
3d
3 days ago
·
Hacker News
Actions for How to Measure Time To First Token (TTFT) in AI Systems
Sign up or log in to see more results
Sign Up
Login
« Page 2
Log in to enable infinite scrolling
Keyboard Shortcuts
Navigation
Next / previous item
j
/
k
Open post
o
or
Enter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
g
h
Interests
g
i
Feeds
g
f
Likes
g
l
History
g
y
Changelog
g
c
Settings
g
s
Browse
g
b
Search
/
Pagination
Next page
n
Previous page
p
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc
Press
?
anytime to show this help