💾 Prompt Caching - emschwartz · Scour

SparKV: Overhead-Aware KV Cache Loading for Efficient On-Device LLM Inference 🧠LLM Inference

Qwen 3.6-35B-A3B KV cache bench: f16 vs q8_0 vs turbo3 vs turbo4 from 0 to 1M context on M5 Max 🖥️Hardware Architecture

llmkube.com·2d·r/LocalLLaMA

Claude Code ships with a built-in skill for working with the Claude Platform. 💻Claude Code

threadreaderapp.com·1d

Gemma 4 and Qwen 3.6 with q8_0 and q4_0 KV cache: KL divergence results ⚡Prefetching

localbench.substack.com·6d·r/LocalLLaMA

I Tested All 4 DeepSeek V4 Modes on 20 Real Tasks — The $0.04 Flash Won 7 of Them 🔬RaBitQ

pub.towardsai.net

·5d

I got a $134 Cloudflare D1 bill. Here's how I cut it 95% ☁️Cloudflare D1

fullstacksveltekit.com·3d·Hacker News

Rethinking KV Cache Eviction via a Unified Information-Theoretic Objective 🧠LLM Inference

Google splits AI chips into training and inference TPUs, signaling shift toward workload-specialized AI infrastructure 📱Edge AI Optimization

digitimes.com·6d

DepthKV: Layer-Dependent KV Cache Pruning for Long-Context LLM Inference 🧠LLM Inference

PolyKV: A Shared Asymmetrically-Compressed KV Cache Pool for Multi-Agent LLM Inference 🧠LLM Inference

CacheFlow: Efficient LLM Serving with 3D-Parallel KV Cache Restoration 🔄Cache Coherence

Stochastic KV Routing: Enabling Adaptive Depth-Wise Cache Sharing 🧠Memory Hierarchy Design

Salca: A Sparsity-Aware Hardware Accelerator for Efficient Long-Context Attention Decoding ⚡Hardware Acceleration

Sparse Forcing: Native Trainable Sparse Attention for Real-time Autoregressive Diffusion Video Generation 📦Batch Embeddings

No more posts from emschwartz's subscribed feeds.

Scour all 24432 feeds Learn more about Feeds

Log in to enable infinite scrolling