LLMs on a Shoestring: The Dynamic Cache Advantage by Arvind Sundararajan
dev.to·16h·
Discuss: DEV
💾Cache Algorithms
StringWa.rs on GPUs: Databases & Bioinformatics 🦠
ashvardanian.com·7h·
Discuss: Hacker News, r/programming
🚀Tokenizer Performance
Analog IMC Attention Mechanism For Fast And Energy-Efficient LLMs (FZJ, RWTH Aachen)
semiengineering.com·10h
🗺️Region Inference
Topological Sort: Managing Mutable Structures in Haskell
mmhaskell.com·18h
🪢Rope Data Structures
Rowhammer: TRR on DDR5 DRAM has been broken
comsec.ethz.ch·10h·
Discuss: Hacker News, r/hardware
🏷️Memory Tagging
Is Recursion in LLMs a Path to Efficiency and Quality?
pub.towardsai.net·2h
🪜Recursive Descent
Building High-Performance Caching in Go: A Practical Guide
dev.to·1d·
Discuss: DEV
🧠Memory Models
LAVa: Layer-wise KV Cache Eviction with Dynamic Budget Allocation
arxiv.org·22h
🗺️Region Inference
Power Query Secret Tip to Lightning-Fast Approximate Matches
geeky-gadgets.com·14h
📊Query Optimizers
Semantic Dictionary Encoding
falvotech.com·12h·
Discuss: Hacker News
🗂️Type Indexing
Rendezvous Hashing Explained (2020)
randorithms.com·7h·
Discuss: Lobsters, Hacker News, r/programming
🔗Hash Algorithms
More hardware won’t fix bad engineering
infoworld.com·17h
🔮Branch Predictors
Fastest copy
forums.anandtech.com·10h
⚡Copy Elision
What is Algebraic about Algebraic Effects?
interjectedfuture.com·10h
💫Effect Systems
Google releases VaultGemma, its first privacy-preserving LLM
arstechnica.com·5h
🎲Parser Fuzzing
What Facebook's Memcache Taught Me About Systems Thinking
lorbic.com·9h·
Discuss: Hacker News
⚡Cache-Aware Algorithms
Explaining the LMAX Disruptor
lmax-exchange.github.io·5d·
Discuss: DEV
🎯Ring Buffers
H100 PCIe – 1.86 TB/s memcpy roofline and 8× uplift
news.ycombinator.com·2d·
Discuss: Hacker News
🧠Memory Hierarchy
Conquering the LLM Memory Wall: How to Run 2–4x Longer Contexts with a Single Line of Code
reddit.com·15h·
Discuss: r/LocalLLaMA
🗺️Region Inference
Advancing Semiconductor Design: Intel’s Foveros 2.5D Packaging Technology
semiwiki.com·13h
🔧RISC-V