🪟 Context Windows - bloknayrb · Scour

RedKnot: Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

🤖LLM Academic

Big Blue’s Redbook on Storage Scale KV Cache management

🤝AI Agents News

blocksandfiles.com·

KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

🤖LLM Code

github.com··Hacker News

The Memory Problem is Solved: How Google’s Memory Caching Makes RNNs Smart Again

🤖LLM Blog

Larger context windows and configurable reasoning levels for GitHub Copilot - GitHub Changelog

💬LLMs Blog

github.blog··Hacker News

libertywing/FlashMemory-Deepseek-V4: FlashMemory DS-V4 Retriever: a lightweight retriever that sparsifies DeepSeek-V4 CSA KV-cache. Weights available on Hugging Face.

💻Terminal Emulators Code

How we fight GPU scarcity without compromise

🤖LLM Blog

equixly.com··Hacker News

How LLMs Actually Work: A Friendly Map for Humans • oreoro

oreoro.github.io··Hacker News

manavgup/context-analyzer: Context window usage analyzer for Claude Code — MCP server + interactive dashboard

🔌MCP Code

github.com··Hacker News

End-to-End Context Compression at Scale

💬LLMs Academic

Analyze Codex session logs for token cost, cache usage, compactions, and tool churn

gist.github.com··Substack

google/gemma-4-12B-it-qat-q4_0-gguf

huggingface.co·

Hugging Face Transformers RCE flaw enables stealthy compromise via AI model configs

csoonline.com·

Context Engineering vs. Prompt Engineering: Why Your AI Agent Gets Dumber the Longer It Runs

💬LLMs Blog

·

Towards Tight Bounds for Streaming Attention

💬LLMs Academic

Making Local LLM Go Brrr

seanpedersen.github.io·

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

local-llm.utop.workers.dev··Hacker News

FlashMemory-DeepSeek-V4: Lightning Index Ultra-Long Context via Lookahead Sparse Attention

🤖LLM Academic

arxiv.org··Hacker News

heterodoxin/graphkv: Graph-guided KV cache compression for memory-efficient LLM inference.

🤖LLM Code

github.com··r/LocalLLaMA

Blurry Window Attention

🎯Hyperfocus Academic

Log in to enable infinite scrolling