🧠 Memory Management - hello · Scour

Day 3 - Chunking 🗄️Database Sharding

dev.to·2d·DEV

When Does Value-Aware KV Eviction Help? A Fixed-Contract Diagnostic for Non-Monotone Cache Compression ⏪Deoptimization

Shepherd: A Runtime Substrate Empowering Meta-Agents with a Formalized Execution Trace 🕵️Jaeger

ClickHouse/silk: Fast stackful fibers with a NUMA-aware work-stealing scheduler 📊Profiling Tools

github.com·6d·Hacker News

RateQuant: Optimal Mixed-Precision KV Cache Quantization via Rate-Distortion Theory 🚀Superoptimization

I built a baremetal RustOS (O(1)allocator NVMeDMA ZeroTrust sandbox for AIAgents 🐧Rust for Linux

github.com·3d·Hacker News

Mastering Memory Management: Insights from Bjarne Stroustrup 🛡️Memory Safety

dev.to·3d·DEV

Avoiding The GC in D: Stack, Buffers & Arenas 📚Stack Unwinding

dev.to·3d·DEV

Internals: How LangChain 0.3 and Pinecone 2.0 Manage RAG Memory for 10k Documents 📊Vectorized Query Execution

dev.to·4d·DEV

ipc_shared_ptr: A Publish/Subscribe-Aware Smart Pointer for Cross-Process Object Lifetime Management 🗺️Memory-Mapped Queues

tierKV: A Distributed KV Cache That Makes Evicted Blocks Faster to Restore Than GPU Cache Hits 🌊Memory Bandwidth

dev.to·3d·DEV

Lighthouse 100 and Still Crashes: OOM Explained 🔗Intrusive Containers

dev.to·5d·DEV

When Quantization Is Free: An int4 KV Cache That Outruns fp16 on Apple Silicon 🏗Computer Architecture

Tutti: Making SSD-Backed KV Cache Practical for Long-Context LLM Serving 🎴TAO

eOptShrinkQ: Near-Lossless KV Cache Compression Through Optimal Spectral Denoising and Quantization ⏲️TimescaleDB Compression

HeadQ: Model-Visible Distortion and Score-Space Correction for KV-Cache Quantization 🌊Memory Bandwidth

No more posts from hello's subscribed feeds.

Scour all 24963 feeds Learn more about Feeds

Log in to enable infinite scrolling