⚡ Low-Latency Systems - surajkadapa · Scour

Enabling A Critical Phase in SoC Development 🔧HLS

semiengineering.com·3h

Runway News | 60x Faster Cold Starts: Treating Peer GPUs as Weight Servers ⭕Ring Buffers

runwayml.com·20h·Hacker News

When benchmarks go bad - what I learned from measuring performance wrong ⚡Performance Engineering

hollycummins.com·2d

PCIe 7.0: Addressing legacy ordering limitations with UIO 💾NVMe

SMG: The Case for Disaggregating CPU from GPU in LLM Serving ⚡Hardware Acceleration

pytorch.org·14h·Hacker News

Boosting multimodal inference performance by >10% with a single Python dictionary ⚡Hardware Acceleration

Find and fix bottlenecks. 🖥️Operating Systems

joyofconvening.substack.com·18h·Substack

The Limits of Mathematical Computation Applied to Physical Hardware 🔓Lock-Free Programming

programmingsimplicity.substack.com·2d·Substack

Future CPU 🏗️Computer Architecture

forums.anandtech.com·3d

Microsoft at NSDI 2026: Advances in large-scale networked systems 🌐XDP

microsoft.com·18h

vLLM Real-World Lab Report 🖥️Hypervisors

avkcode.github.io·2d·Hacker News

Micron's CEO says AI memory demand is just in its 'first innings' and memory supply is already insufficient 💾Persistent Memory

tweaktown.com·12h

Benchmarking Echo-TTS on Strix Halo ⚡Hardware Acceleration

sleepingrobots.com·3d

The Engineering Constraints of Distributed LLM Inference over the Open Internet 🔁Cache Coherence

siliconandsoul.substack.com·2d·Substack

Tutti: Making SSD-Backed KV Cache Practical for Long-Context LLM Serving 🔁Cache Coherence

Stochastic KV Routing: Enabling Adaptive Depth-Wise Cache Sharing 📦CPU Caches

machinelearning.apple.com·1d

Hardware-assisted Arm VMs for s390 🖥️Hypervisors

·19h

Best AI Coding Models for Consumer Hardware (5 You Can Run Locally) ⚡Hardware Acceleration

firethering.com·4d·Hacker News

Replacing GPU Compute Dies With PNM-Enabled HBM Cubes For Long-Context Decode Attention (UCSD, Columbia, Yonsei U., NVIDIA, Samsung) 🧠FPGA Memory

semiengineering.com·14h

Performance Tuning and Scaling Optimization for Large-Scale Azure Workloads ⚡Performance

techcommunity.microsoft.com·1d

Log in to enable infinite scrolling