Attention Optimization

Feeds to Scour
SubscribedAll
Scoured 25 posts in 6.9 ms

Vortex: Efficient and Programmable Sparse Attention Serving for AI Agents

 🧩Attention Kernels  Content type: Academic
arxiv.org·

KaiFelixBennett/gemma4-turboquant-rdna4: Run Gemma-4-31B at full 256K context on a $1,400 AMD RDNA4 GPU (gfx1201): TurboQuant KV cache + HIP-graph-safe Flash-Attention for llama.cpp, fully measured on real hardware.

 🔥PyTorch  Content type: Code
github.com··Hacker News

Testing MiniMax M3 on real tasks: repo refactor, screenshot debugging, and Spotify recommendations

 📊Profiling Tools  Content type: Blog

The Memory Problem is Solved: How Google’s Memory Caching Makes RNNs Smart Again

 Flash Attention  Content type: Blog
medium.com·

Hugging Face Transformers RCE flaw enables stealthy compromise via AI model configs

 Flash Attention
csoonline.com·

ELI5 is a terrible learning prompt, here's the structural reason it fails and a 4-level replacement that actually sticks

 🧩Attention Kernels  Content type: Blog  Content type: Tutorial

DeepSeek V4, LeCun's Bet Against LLMs, and Lovable's Self-Improving Agent - The Tokenizer Edition #30

 🔄ONNX

Two Leaps to 1000 Tokens/s on a 1T-Parameter Model: On Inference Systems, Execution Boundaries, and Co-Design

 ⚙️Systems Programming  Content type: Blog
tilert.ai··Hacker News

linzhiqiu/t2v_metrics: Evaluating text-to-image/video/3D models with VQAScore

 🚀MLOps  Content type: Code
github.com··Hacker News

Efficient and Training-Free Single-Image Diffusion Models

 🧩Attention Kernels

Deep Learning Weekly: Issue 458

 ONNX Runtime

FlashMemory-DeepSeek-V4: Lightning Index Ultra-Long Context via Lookahead Sparse Attention

 Flash Attention  Content type: Academic
arxiv.org··Hacker News

LLM Research Papers: The 2026 List (January to May)

 📉Model Quantization  Content type: News

libertywing/FlashMemory-Deepseek-V4: FlashMemory DS-V4 Retriever: a lightweight retriever that sparsifies DeepSeek-V4 CSA KV-cache. Weights available on Hugging Face.

 Flash Attention  Content type: Code
github.com·

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

 🛠Ml-eng

TilelliLab/atome-lm: A ternary, zero-heap tiny language model that runs inside a $2 microcontroller — bit-exact Python <-> C99 <-> Cortex-M3 (QEMU) parity. Apache-2.0.

 🐍Python  Content type: Code
github.com··r/LLM

You Only Index Once: Cross-Layer Sparse Attention with Shared Routing

 🧩Attention Kernels  Content type: Academic
arxiv.org·

stable-diffusion.cpp/docs/quantization_and_gguf.md at master · leejet/stable-diffusion.cpp

 🔄ONNX  Content type: Code

From Rigid to Dynamic: Entropy-Guided Adaptive Inference for Long-Context LLMs

 🎓Model Distillation  Content type: Academic
arxiv.org·

Sparrow: Sparse Rollout for Stable and Efficient Long-context RL of Large Language Models

 📊Gradient Accumulation  Content type: Academic
arxiv.org·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help