⚡ FlashAttention - nayyara.airlangga · Scour

Demystifying FlashAttention: Building v1 from Scratch in Pure PyTorch ⚗️Kernel Fusion

medium.com·3d

Top-K Retrieval with Fixed-Size Linear-Attention Completion: Backbone- and KV-Format-Preserving Attention for KV-Cache Read Reduction 💾KV Cache

arxiv.org·2d

GPU Memory for LLM Inference: Why Llama-70B Doesn't Fit 🧠Inference Engineering

darshanfofadiya.com·4d·Hacker News

Save 4× GPU Memory With One Line of Python: TurboQuant + HuggingFace 🗜️Quantization

medium.com·4d

New 'GeForge' and 'GDDRHammer' attacks can fully infiltrate your system through Nvidia's GPU memory — Rowhammer attacks in GPUs force bit flips in protected VRAM regions to gain read/write access ⚗️Kernel Fusion

tomshardware.com

·6d

CVE-2026–5283: Uninitialized GPU Memory Disclosure via Partial Clear in ANGLE (Chrome WebGL) ⚗️Kernel Fusion

medium.com·4d

HybridKV: Hybrid KV Cache Compression for Efficient Multimodal Large Language Model Inference 🚀Speculative Decoding

arxiv.org·2d

GPU Memory Math for LLMs: 2026 Edition ⚗️Kernel Fusion

medium.com

·6d

GPUBreach exploit uses GPU memory bit-flips to achieve full system takeover ⚗️Kernel Fusion

securityaffairs.com·3d

GDDRHammer and GeForge: 1,171 bit flips on RTX 3060, 202 on RTX A6000, both escalate to root shell via GDDR6 Rowhammer ⚗️Kernel Fusion

blog.barrack.ai·5d·r/hardware, r/netsec

Intel Pulls the Plug on XeSS Support in Unity Game Engine ⚗️Kernel Fusion

techpowerup.com·4d

GRASS: Gradient-based Adaptive Layer-wise Importance Sampling for Memory-efficient Large Language Model Fine-tuning 🚀Speculative Decoding

arxiv.org·14h

What is an AI Native Cloud? 📝Infrastructure as Code

together.ai·3d

I tested Fedora Miracle: Why Linux needs a 'broken' flag for orphaned spins ⚗️Kernel Fusion

zdnet.com·4d

Fast Cross-Operator Optimization of Attention Dataflow 🔢GEMM Optimization

arxiv.org·3d

Diagonal-Tiled Mixed-Precision Attention for Efficient Low-Bit MXFP Inference 🔢GEMM Optimization

arxiv.org·3d

AEGIS: Scaling Long-Sequence Homomorphic Encrypted Transformer Inference via Hybrid Parallelism on Multi-GPU Systems 🚀Speculative Decoding

arxiv.org·3d

Effect of Input Resolution on Retinal Vessel Segmentation Performance: An Empirical Study Across Five Datasets ⚗️Kernel Fusion

arxiv.org·4d

FluxMoE: Decoupling Expert Residency for High-Performance MoE Serving 🚀Model Serving

arxiv.org·4d

Rethinking Token Prediction: Tree-Structured Diffusion Language Model 🚀Speculative Decoding

arxiv.org·3d

Loading more...