AMD MI300X for LLM Serving Disaggregating Prefill and Decode with SGLang
rocm.blogs.amd.com·3d·
Discuss: Hacker News
🌊Streaming Compression
Matrix Multiplication on Nvidia's Blackwell: Part 1 – Introduction
modular.com·2d·
Discuss: Hacker News
⚡SIMD Optimization
Art Index in ShannonBase
medium.com·1d·
Discuss: Hacker News
🗄️SQLite Internals
Latency, Tail Latency and Response time in distributed systems
andrewpakhomov.com·7h·
Discuss: Hacker News
🌊Stream Processing
System Performance of Edge AI Applications is Beyond Models
dev.to·1d·
Discuss: DEV
📊Performance Profiling
Proxmox Disk Caching Modes
blog.raymond.burkholder.net·4d
💿Proxmox HA
Using LLMs for Intel Processor Code Trace Analysis
alansguigna.com·2d·
Discuss: Hacker News
🔩Systems Programming
Abstract Machine Models Also: what Rust got particularly right
dr-knz.net·1d·
Discuss: Hacker News
🔩Systems Programming
Explaining the Need for Strongly Happens Before in C++
nekrozqliphort.github.io·4d·
Discuss: Hacker News, r/cpp
✨Effect Handlers
MyGO: Memory Yielding Generative Offline-consolidation for Lifelong Learning Systems
arxiv.org·3h
🧠Machine Learning
LLMs running locally
markjgsmith.com·1d
🌀Brotli Internals
Server consolidation / advice
reddit.com·15h·
Discuss: r/homelab
🏠HomeLab
Concurrency vs parallelism stop mixing them up, it’s embarrassing
dev.to·2d·
Discuss: DEV
🔄Lens Laws
GPUPrefixSums – state of the art GPU prefix sum algorithms
github.com·3d·
Discuss: Hacker News
🎨LUT Compression
How is Ultrassembler so fast?
jghuff.com·14h·
Discuss: Hacker News, r/programming
⚙️Modern Assembly
SQLite Is Edge Scale
fermyon.com·2d·
Discuss: Hacker News
🗄️Database Sharding
Title: Boosting Efficiency with Prompt Caching in APIs
dev.to·1d·
Discuss: DEV
🏎️Varnish Cache
Condor’s Cuzco RISC-V Core at Hot Chips 2025
chipsandcheese.com·2d·
Discuss: Hacker News, Hacker News, Hacker News, r/hardware
⚙️Modern Assembly
From Multi-Head to Latent Attention: The Evolution of Attention Mechanisms
vinithavn.medium.com·2d·
Discuss: Hacker News
⧗Information Bottleneck
Quantum Algorithm Verification via Multi-Modal Data Fusion & HyperScore Analytics
dev.to·9h·
Discuss: DEV
⚛️Quantum LDPC