Why I Ditched Malloc for AI Inference
gilli.dev·7h·
Discuss: Hacker News
🧠Memory Allocators
Anything can be a message queue if you use it wrongly enough
xeiaso.net·12h·
Discuss: Hacker News, r/programming
🌐Pingora
Unleashing Heterogeneous Compute: Lessons From Real-World System Design
semiengineering.com·20h
⚙️Mechanical Sympathy
Cut The Abstractions, Software is Not a Piece of Art
levelup.gitconnected.com·15h·
Discuss: r/SoftwareEngineering
👨‍💻Software development practices
Pushing Blocks without Fixed Blocks via Checkable Gizmos: Push-1 is PSPACE-Complete
arxiv.org·23h
🧮SMT Solvers
AMD MI300X for LLM Serving Disaggregating Prefill and Decode with SGLang
rocm.blogs.amd.com·3h·
Discuss: Hacker News
💾Prompt Caching
From Black Box to Blueprint
martinfowler.com·16h
🔍Binary Analysis
AMD details how it built a product line-up with just two RDNA 4 dies — Flexible design and asymmetric harvesting enables production of multiple models without n...
tomshardware.com·15h
🖥GPUs
Byte Tank - Pedro Lopes Blog
lopespm.com·2h
🪄Prompt Engineering
Review — Code (Charles Petzold)
blog.hackernewsbooks.com·9h
🪄Prompt Engineering
Intro to Java FFM - Foreign Function & Memory Access API (Project Panama)
roray.dev·20h·
Discuss: Hacker News
🏊Memory Pools
GPUPrefixSums – state of the art GPU prefix sum algorithms
github.com·14h·
Discuss: Hacker News
⚙️Mechanical Sympathy
Notes on Programming in C by Rob Pike
lysator.liu.se·2h·
Discuss: Hacker News
💻Programming languages
Profanity causes emergent misalignment, but with qualitatively different results than insecure code
lesswrong.com·19h
🛡️AI Safety
Which local LLM will work best with Beelink
bee-link.com·6h·
Discuss: r/LocalLLaMA
⚙️Mechanical Sympathy
OOP and the expression problem
bennett.ink·8h·
Discuss: r/programming
🔌API Design Theory
Axis, EPMD, and You
nautilus.institute·14m·
Discuss: Hacker News
🌐Pingora
Project MiniNAS
jadarma.github.io·3h·
Discuss: Hacker News
🔬RaBitQ
Next-generation graph computing with electric current-based and quantum-inspired approaches
nature.com·17h
⚡Hardware Acceleration
On Joining the Mojo Compiler Team
verdagon.dev·10h·
Discuss: Hacker News
🪄Prompt Engineering