📦 CPU Caches - surajkadapa · Scour

M5 Max is faster than M3 Ultra for many MLX benchmarks (prefill 2x, decode for MoEs despite having lower memory bandwidth).

twitter.macworks.dev

·23h

⚡Hardware Acceleration

DeepSeek V3 Deep Dive

habib.bearblog.dev·1d

♟️Chess Engines

Less-relevant results

ArcLight: A Lightweight LLM Inference Architecture for Many-Core CPUs

arxiv.org·19h

theoddden/Terradev: NUMA-aware GPU provisioning and orchestration for stateless MoE workloads of all sizes - *Claude Code native*

github.com·4d·

Discuss: Hacker News

⚡Hardware Acceleration

RPU: A Chiplet-Based Architecture To Address The Challenges of the Modern Memory Wall (Harvard University)

semiengineering.com·6d

📐Data-Oriented Design

FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling

together.ai·5d·

Discuss: Hacker News, r/LocalLLaMA

⚡Hardware Acceleration

Custom Keep-Alive Cache Policies

arxiv.org·6d

Cacheman: A Comprehensive Last-Level Cache Management System for Multi-tenant Clouds

danglingpointers.substack.com·11h·

Discuss: Substack

💾Cache Optimization

The KV Cache: The Invisible Engine Behind Every LLM Response

pub.towardsai.net

·1d

🔁Cache Coherence

Intel’s Nova Lake-AX for Local LLMs – What We Know So Far About AMD’s Halo Competitor

hardware-corner.net·6d·

Discuss: Hacker News

⚡Hardware Acceleration

A Technical Deep Dive into Amazon EC2 Hpc8a Performance for Engineering and Scientific Workloads

aws.amazon.com·5d

Micron launches first 256 GB SOCAMM2 modules; memory becomes the new AI bottleneck

igorslab.de·5d

🔁Cache Coherence

In-memory Data Management Caching Tools: A Guide to the Best Options

akamai.com·1d

🗄️Database Internals

CPU Cache Coherence in Java Concurrency

tutorials.jenkov.com·1d

Web Cache Basics for Beginners: Understanding Cache, Cache Keys, and Cache Rules

medium.com·7h

AI on a Budget: Recompiling Llama.cpp for Qwen3.5 Inference on an HP Z440

jeanbaptistefleury.neocities.org·15h·

Discuss: Hacker News

⚡Hardware Acceleration

Colorado’s Big Push for 2026: New Tourism Grants Designed to Elevate Inbound Travel and Local Community Involvement

travelandtourworld.com·24m

📚Index Structures

Oscars 2026: What the Stars Will Eat and Drink at the Governors Ball (PHOTOS)

variety.com·24m

📇Vector Indexing

No 10 to release hundreds of files relating to Mandelson being made ambassador

theguardian.com·24m

🔐Cryptography

Newcastle demonstrate both best and worst qualities in brilliant but agonising draw with Barcelona

the-independent.com·25m

Loading more...