Feeds to Scour
SubscribedAll
Scoured 20535 posts in 236.2 ms
Large-Scale LLM Inference with Heterogeneous Workloads: Prefill-Decode Contention and Asymptotically Optimal Control
arxiv.org·15h
🧠LLM Inference
​Sequential Attention: Making AI models leaner and faster without sacrificing accuracy
research.google·5h
🧠LLM Inference
AI Cost Considerations Every Engineer Should Know
vantage.sh·1d·
Discuss: Hacker News
💰Tokenomics
Optimized LLM Inference Engines
rishirajacharya.com·5h
🏗️LLM Infrastructure
Beyond Two Towers: Re-architecting the Serving Stack for Next-Gen Ads Lightweight Ranking Models…
medium.com·2d
🏗️LLM Infrastructure
What Actually Breaks ML Models in Production: A Fintech Case Study
pub.towardsai.net·8h
🏗️LLM Infrastructure
ML for Energy-Performance-Aware Scheduling On Heterogeneous Multicore Architectures (Cambridge)
semiengineering.com·1d
📊Model Serving Economics
nilpunch/massive-ecs: Bitset-based ECS with rollbacks. C# library and Unity package.
github.com·17h
🗄LiteFS
Understanding LLM Inference Engines: Inside Nano-vLLM (Part 1)
neutree.ai·2d·
Discuss: Hacker News, r/programming
🏗️LLM Infrastructure
When “Where’s My Package?” Turns Into a Real Time Logistics Analytics Problem
singlestore.com·5h
⚡ClickHouse
Nemotron Labs: How AI Agents Are Turning Documents Into Real-Time Business Intelligence
blogs.nvidia.com·4h
🏗️LLM Infrastructure
Show HN: Tabstack Research – An API for verified web research (by Mozilla)
news.ycombinator.com·2h·
Discuss: Hacker News
🔍Quickwit
Postdoc in Milan on scalability for high-dimensional Bayesian learning
statmodeling.stat.columbia.edu·1d
🏗️LLM Infrastructure
RePo provides an innovative solution to long-context tasks in LLMs
bdtechtalks.substack.com·1d
🏗️LLM Infrastructure
Data Integration
databricks.com·1d
📦In-process Databases
Driving vLLM WideEP and Large-Scale Serving Toward Maturity on Blackwell (Part I)
blog.vllm.ai·1d
🏗️LLM Infrastructure
Building an RSS Aggregator with Astro
raymondcamden.com·2d
📡RSS
PRISM: Parametrically Refactoring Inference for Speculative Sampling Draft Models
arxiv.org·1d
📊Model Serving Economics
High-performance inference meets serverless compute with NVIDIA RTX PRO 6000 on Cloud Run
cloud.google.com·2d
🖥GPUs
Polling vs. Long Polling vs. SSE vs. WebSockets vs. Webhooks
blog.algomaster.io·1d
📡Network Latency

Keyboard Shortcuts

Navigation
Next / previous item
j/k
Open post
oorEnter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help