Bit Packing, Structure Layout, Memory Efficiency, Cache Optimization

H1B-KV: Hybrid One-Bit Caches for Memory-Efficient Large Language Model Inference
arxiv.org·2h
🗺️Region Inference
Fast Matrix Multiply on an Apple GPU
percisely.xyz·9h·
Discuss: Hacker News
🔀SIMD Programming
CPU Cache-Friendly Data Structures in Go: 10x Speed with Same Algorithm
skoredin.pro·1d·
Discuss: Hacker News
Cache Optimization
Introducing OpenZL: An Open Source Format-Aware Compression Framework
engineering.fb.com·1d·
📦Compression Algorithms
Node.js Performance: Processing 14GB Files 78% Faster with Buffer Optimization
dev.to·14h·
Discuss: DEV
📋JSON Parsing
Beating the L1 cache with value speculation (2021)
mazzo.li·1d·
🔮Branch Predictors
SDQ-LLM: Sigma-Delta Quantization for 1-bit LLMs of any size
reddit.com·1d·
Discuss: r/LocalLLaMA
📏Linear Memory
Self-Extracting F3
buttondown.com·1d·
Discuss: Hacker News
📊Row Polymorphism
The Next Computing Revolution: Bringing Processing Inside Memory
computer.org·1d·
Discuss: Hacker News
🧠Memory Models
Walrus, A 1M ops/sec, 1 GB/s Write Ahead Log in Rust
nubskr.com·14h·
💾Zero-Copy
Beginner to NAS...Build Advice?
preview.redd.it·11h·
Discuss: r/homelab
🌳B+ Trees
LLM Optimization Notes: Memory, Compute and Inference Techniques
gaurigupta19.github.io·1d·
Discuss: Hacker News
🗺️Region Inference
Show HN: Blueprintor for Hardware Engineering
zima.run·16h·
Discuss: Hacker News
🌐Portable Assembly
The Chip That Spoke Lisp
jxself.org·18h
🖥️Lisp Machines
Toy Binary Decision Diagrams
philipzucker.com·2d
Type Checking
Reflections on Designing a Search Autocomplete System
torontostudygroup.github.io·2d·
Discuss: DEV
🌿Trie Structures
Making performant Python bindings to compiled code
kylebarron.dev·15h·
Discuss: Hacker News
📋JSON Parsing
Static Bundle Object: Modernizing Static Linking
medium.com·15h·
Discuss: Hacker News
🌈Gradual Languages
A Primer on Memory Consistency and Cache Coherence, Second Edition
link.springer.com·2d·
Discuss: r/programming
🧠Memory Models
Fun with HyperLogLog and SIMD
vaktibabat.github.io·3d·
🔢Bit Manipulation