Why I Ditched Malloc for AI Inference
gilli.dev·14h·
Discuss: Hacker News
🧠Memory Allocation Strategies
Brioche Project Update - August 2025
brioche.dev·7h
🛠️Build Optimization
Dynamic KV Cache Scheduling in Heterogeneous Memory Systems for LLM Inference (Rensselaer Polytechnic Institute, IBM)
semiengineering.com·6h
🧠LLM Inference
AMD MI300X for LLM Serving Disaggregating Prefill and Decode with SGLang
rocm.blogs.amd.com·10h·
Discuss: Hacker News
💾Prompt Caching
Multi-Agent Systems: Exploring Agent Orchestration
pub.towardsai.net·12h
🪄Prompt Engineering
Anything can be a message queue if you use it wrongly enough
xeiaso.net·19h·
Discuss: Hacker News, r/programming
🌐Pingora
Controlling the Rollout of Large-Scale Monorepo Changes
uber.com·21h
🌐Distributed systems
Partytown: Optimize Third Party Scripts with Web Workers
debugbear.com·14h
🚀Web Performance
Project MiniNAS
jadarma.github.io·10h·
Discuss: Hacker News
🔬RaBitQ
Mojo Roadmap Document
docs.modular.com·56m·
Discuss: Hacker News
💻Programming languages
Evolving Kubernetes for generative AI inference
infoworld.com·1h
🧠Inference Serving
From Black Box to Blueprint
martinfowler.com·23h
🔍Binary Analysis
Prompt Engineering for Grok Code Fast 1
docs.x.ai·11h·
Discuss: Hacker News
💾Prompt Caching
Which local LLM will work best with Beelink
bee-link.com·13h·
Discuss: r/LocalLLaMA
⚙️Mechanical Sympathy
Mechanistic origins of temperature scaling in the early embryonic cell cycle
nature.com·20h
🦠Fermentation
Notes on Programming in C by Rob Pike
lysator.liu.se·9h·
Discuss: Hacker News
💻Programming languages
Byte Tank - Pedro Lopes Blog
lopespm.com·9h
🪄Prompt Engineering
Compilation vs. vectorization, search engine edition
jpountz.github.io·21h·
Discuss: Hacker News
🔍Query Optimization
GPUPrefixSums – state of the art GPU prefix sum algorithms
github.com·22h·
Discuss: Hacker News
⚙️Mechanical Sympathy
I’ve been working on something new:
threadreaderapp.com·21h
🪄Prompt Engineering