🔁 Cache Coherence - hello · Scour

Understanding KV Cache in LLMs and How It Affects Inference 🦙Ollama

pub.towardsai.net

·3d

Cache Use Cases Explained: Latency Cache vs. Capacity Cache 💾Cache Design

read.thecoder.cafe·6d·r/SoftwareEngineering, r/coding

When Stability Improves Performance (Threading) 📍CPU Pinning

dev.to·2d·DEV

nviennot/core-to-core-latency: Measures the latency between CPU cores 📊Intel PMU

github.com·4h·Hacker News

Replacing GPU Compute Dies With PNM-Enabled HBM Cubes For Long-Context Decode Attention (UCSD, Columbia, Yonsei U., NVIDIA, Samsung) 💾HBM

semiengineering.com·6d

The M:N Concurrent Model — A Complete Guide. From First Principles to Production Schedulers 🧵Lightweight Threads

0xkiire.com·3d·Hacker News, r/golang, r/rust

AF_ALG page-cache cross-container pivot: Part I 🔗Intrusive Containers

linkedin.com·3d·Lobsters

How CPU Memory and Caches Work [video] 🧠Memory Management

youtube.com·3d·Hacker News

How Unsloth and Nvidia made LLM training 25% faster on consumer GPUs 🔄Hardware Transactional Memory

unsloth.ai·5d·Hacker News

Evaluating Geekbench 6 ⚙️Performance Profiling

chipsandcheese.com·4d·Hacker News, r/hardware

ipc_shared_ptr: A Publish/Subscribe-Aware Smart Pointer for Cross-Process Object Lifetime Management 🗺️Memory-Mapped Queues

yantrikos/yantrikdb: Cognitive memory engine for AI agents — temporal decay, contradiction detection, autonomous consolidation, knowledge graph, ANN recall via HNSW. Embeddable Rust library with Python bindings; powers yantrikdb-server (HTTP gateway, MCP server, openraft cluster). AGPL. 🎴TAO

github.com·2h·Hacker News

A new era for memory-management maintainership 🧱Slab Allocation

·5d

Enabling A Critical Phase in SoC Development 🎛️SmartNICs

semiengineering.com·6d

Could anyone give me some insight into concurrency 🔄Concurrency

youtu.be·6d·r/programming

Compressing KV caches with a related model 🌊Memory Bandwidth

fergusfinn.com·4d·Hacker News

Part 1 ⚡LMAX Disruptor

modular.com·4d

Getting peak TOPS on a Ryzen AI 7 350 NPU ⚡Hardware Acceleration

destevez.net·4d·Lobsters, Hacker News

Burn 0.21.0 Release: Up to 8× Lower Framework Overhead, Differentiable Collectives and Improved Kernels 🐧Rust for Linux

Built a dpdk-inspired lock-free queue and found some surprising perf behavior 🌊DPDK Mempool

github.com·2d·r/cpp

No more posts from hello's subscribed feeds.

Scour all 24963 feeds Learn more about Feeds

Sign up or log in to see more results

Log in to enable infinite scrolling