The Art of Abstraction — Polymorphic Memory Allocator
unboxthecat.medium.com·1d·
Discuss: r/cpp
🏗️Custom Allocators
H1B-KV: Hybrid One-Bit Caches for Memory-Efficient Large Language Model Inference
arxiv.org·2h
🗺️Region Inference
Souvenir
deprogrammaticaipsum.com·2d
🔗Weak References
Over the Fence.... And Far Away....
megalomaniacbore.blogspot.com·7h
🎯Ring Buffers
The Next Computing Revolution: Bringing Processing Inside Memory
computer.org·1d·
Discuss: Hacker News
🧠Memory Models
CPU Cache-Friendly Data Structures in Go: 10x Speed with Same Algorithm
skoredin.pro·1d·
Discuss: Hacker News
⚡Cache Optimization
Linux 6.17 changelog (late!): includes a new of selecting CPU bug mitigations; new file_{get,set}attr syscalls; more secure core dumping; initial priority inher...
kernelnewbies.org·9h·
Discuss: r/linux
📊perf Tools
LLM Optimization Notes: Memory, Compute and Inference Techniques
gaurigupta19.github.io·1d·
Discuss: Hacker News
🗺️Region Inference
GaloisInc/parameterized-utils
github.com·4h
📏Linear Haskell
Building Mycelian Memory: An open source persistent memory framework for AI Agents - Would love for you to try it out!
reddit.com·3d·
Discuss: r/LocalLLaMA
📏Linear Memory
We built a CUDA emulator that profiles GPU code with zero hardware
rightnowai.co·1d·
Discuss: Hacker News
🏗️Custom Allocators
MCP Servers Show Us the Limits—and the Promise—of LLM-Native Development
hackernoon.com·6h
🔄Bootstrapping
Static Bundle Object: Modernizing Static Linking
medium.com·15h·
Discuss: Hacker News
🌈Gradual Languages
[PoC] LatentRecall — an experiment in LLM memory that doesn’t store prompts, but computes them on the fly
zenodo.org·23h·
Discuss: r/LocalLLaMA
💬Smalltalk VMs
Latency vs. Accuracy for LLM Apps — How to Choose and How a Memory Layer Lets You Win Both
dev.to·19h·
Discuss: DEV
🎮Language Ergonomics
Walrus, A 1M ops/sec, 1 GB/s Write Ahead Log in Rust
nubskr.com·15h·
Discuss: Lobsters, Hacker News
💾Zero-Copy
Forward declaring a type in C++: The good, and the bad
andreasfertig.com·1d
🧸Toy Compilers
Fast Matrix Multiply on an Apple GPU
percisely.xyz·9h·
Discuss: Hacker News
🔀SIMD Programming
Memory leaks: the forgotten side of web performance (2022)
nolanlawson.com·13h·
Discuss: Hacker News
🔗Weak References
Is Odin Just a More Boring C?
dayvster.com·1d·
Discuss: Hacker News
🐹Go Internals