Compress Vectors by 4x by using 8-bit Rotational Quantization
weaviate.io·19h·
Discuss: Hacker News
🗜️Vector Compression
Why I Ditched Malloc for AI Inference
gilli.dev·6h·
Discuss: Hacker News
🧠Memory Allocation Strategies
A Smarter Path To Chiplets Through An Enhanced Multi-Die Solution
semiengineering.com·19h
🔬Chip Fabrication
MAPo : Motion-Aware Partitioning of Deformable 3D Gaussian Splatting for High-Fidelity Dynamic Scene Reconstruction
arxiv.org·22h
⚡Hardware Acceleration
Next-generation graph computing with electric current-based and quantum-inspired approaches
nature.com·16h
⚡Hardware Acceleration
GPUPrefixSums – state of the art GPU prefix sum algorithms
github.com·14h·
Discuss: Hacker News
⚙️Mechanical Sympathy
the annotated transformer (2022) | hacker news
news.ycombinator.com·20h·
Discuss: Hacker News
🧠LLM Inference
I’ve been working on something new:
threadreaderapp.com·13h
🪄Prompt Engineering
AMD MI300X for LLM Serving Disaggregating Prefill and Decode with SGLang
rocm.blogs.amd.com·2h·
Discuss: Hacker News
💾Prompt Caching
Compilation vs. vectorization, search engine edition
jpountz.github.io·13h·
Discuss: Hacker News
🔍Query Optimization
Gpt-oss Fine-tuning - now with 60K context length and fits on <13GB VRAM
reddit.com·8h·
Discuss: r/LocalLLaMA
📊Model Serving Economics
Notes on Programming in C by Rob Pike
lysator.liu.se·1h·
Discuss: Hacker News
💻Programming languages
Byte Tank - Pedro Lopes Blog
lopespm.com·1h
🪄Prompt Engineering
Speeding up Firefox Local AI Runtime
blog.mozilla.org·9h·
Discuss: Hacker News
⚡Hardware Acceleration
The (Data) Plot Thickens
hackaday.com·18h
📊Vector Databases
AMD details how it built a product line-up with just two RDNA 4 dies — Flexible design and asymmetric harvesting enables production of multiple models without n...
tomshardware.com·14h
🖥GPUs
From Black Box to Blueprint
martinfowler.com·15h
🔍Binary Analysis
What I learned vibe coding a WASM CSV Parser
importcsv.com·7h·
Discuss: Hacker News
🌿Leptos
Explaining the Need for Strongly Happens Before in C++
nekrozqliphort.github.io·23h·
Discuss: Hacker News, r/cpp
🔄Cache Coherence
Let's Build a Hypervisor with KVM
evilcookie.de·14h·
Discuss: Hacker News
💫IO_uring