Show HN: Stateful LLM inference (no cost for input tokens, not prompt-caching)
news.ycombinator.com·5h·
Discuss: Hacker News
💾Prompt Caching
Avalanche stack and real-time streaming applications at Nu
building.nubank.com·4h
🎛️Feed Filtering
ML Observability: Bringing Transparency to Payments and Beyond
netflixtechblog.com·41m
📊Model Serving Economics
How To Tame Alert Fatigue With Time Series Databases
thenewstack.io·2h
🎛️Feed Filtering
Compilation Isn't Just for Programming Languages
architecture-weekly.com·5h·
Discuss: r/programming
🚀Async Optimization
BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-Scale Pretraining
blog.datologyai.com·1h·
Discuss: Hacker News
🧠LLM Inference
guide : running gpt-oss with llama.cpp
github.com·2h·
Discuss: r/LocalLLaMA
🖥GPUs
The Network Times: AI Cluster Networking
nwktimes.blogspot.com·7h·
Discuss: Hacker News
🌐Distributed systems
Don't Buffer, Stream! How IAsyncEnumerable Solves API Performance Issues Solves API Performance Issues
darrenhorrocks.co.uk·6h
🔄Async Runtimes
MoNaCo: More natural questions for reasoning across dozens of documents
allenai.org·2h
🏆LLM Benchmarking
My AI Had Already Fixed the Code Before I Saw It
kill-the-newsletter.com·3h
🪄Prompt Engineering
The Strange Science of Interpretability: Recent Papers and a Reading List for the Philosophy of Interpretability
lesswrong.com·19h
🔍AI Interpretability
Abusing AI interfaces: How prompt-level attacks exploit LLM applications
datadoghq.com·18h
🕳LLM Vulnerabilities
Identify Speakers in Meetings, Calls, and Voice Apps in Real-Time with NVIDIA Streaming Sortformer
developer.nvidia.com·18h
🗜️Zstd
Code Smell 308 - The Key to Safer, Cleaner, More Polymorphic Code
hackernoon.com·14h
🌐Axum
AI = Data + Biases
krnel.ai·18h
🧠LLM Inference
OneUptime – open-source observability platform
github.com·3h·
Discuss: Hacker News
🔍Feed Discovery
AI 'Map Reduce': Scaling AI Tasks
danielsada.tech·10h·
Discuss: Hacker News
👨‍💻Software development practices
How Database Indexing Techniques Impact AI Workloads
singlestore.com·9h
📇Indexing Strategies
Complex Mix Of Processors At The Edge
semiengineering.com·11h
📱Edge AI Optimization