💾 CPU Caching - emschwartz · Scour

Cache-aware disaggregated inference for up to 40% faster long-context LLM serving

together.ai·22h

💾Prompt Caching

Bitsum. Real-time CPU Optimization and Automation

bitsum.com·58m

🔮Prefetching

Avoiding UB but "safe" data race in a lock-free slab allocator - help - The Rust Programming Language Forum

users.rust-lang.org·4h

SIEVE: an Efficient Turn-Key Eviction Algorithm for Web Caches

cachemon.github.io·4h·

Discuss: Hacker News

🎯Data Locality

Beyond a Single Queue: Multi-Level-Multi-Queue as an Effective Design for SSSP problems on GPUs

arxiv.org·17h

📊Model Serving Economics

ktop: Python-based terminal system resource monitor for hybrid LLM workloads

github.com·3h

⚡Systems Performance

How Programmers Spend Their Time

probablydance.com·17h·

Discuss: Hacker News

⚙️Language Runtimes

Monitor Jailbreaking: Evading Chain-of-Thought Monitoring Without

lesswrong.com·5h

💉Prompt Injection

Development of an Energy-Efficient and Real-Time Data Movement Strategy for Next-Generation Heterogeneous Mixed-Criticality Systems

arxiv.org·17h

⚙️Mechanical Sympathy

I can't tell if I love or hate the microcontroller trend lately of "just put another core with a totally different ISA on the bus fabric".

bsky.app·6h·

Discuss: Bluesky

🔐Hardware Security

OSTEP Chapter 8

muratbuffalo.blogspot.com·18h·

Discuss: Blogger

How Memory Technology Is Powering the Next Era of Compute

semiwiki.com·4h

🧠Memory Hierarchy Design

Show HN: Latent-k – Persistent dependency map to reduce AI coding token usage

latentk.org·9h·

Discuss: Hacker News

🔌Claude Plugins

Bringing a jewel-encrusted warhammer to a knife fight

reorchestrate.com·2h·

Discuss: Hacker News

💉Prompt Injection

US Energy Secretary Meets Venezuela's Acting President

bloomberg.com

·39m

⚡Energy Policy

New drones provide first-person thrill to Olympic coverage

techxplore.com·43m

Member of White House Religious Liberty Commission booted after antisemitism hearing

thehill.com·37m

🏛️Politics

Just 8 percent in US see immigration as biggest problem: Gallup

thehill.com·39m

🗽Immigration Policy

James Van Der Beek was so much more than just Dawson

theguardian.com·33m

🚴Bike Infrastructure

Former Super Bowl champion Darron Lee held without bond after death of girlfriend

theguardian.com·1h

⚖️Civil Liberties

Loading more...