Compress Vectors by 4x by using 8-bit Rotational Quantization
weaviate.io·10h·
Discuss: Hacker News
🗜️Vector Compression
Pascal? On my Arduino? It’s More Likely Than You Think
hackaday.com·15h
🔬RaBitQ
Help with an Abandoned OSS project
github.com·20h·
Discuss: r/rust
🌿Leptos
A Smarter Path To Chiplets Through An Enhanced Multi-Die Solution
semiengineering.com·10h
🔬Chip Fabrication
Why are CUDA kernels hard to optimize?
johndcook.com·18h·
Discuss: Hacker News
📊Model Serving Economics
Next-generation graph computing with electric current-based and quantum-inspired approaches
nature.com·7h
⚡Hardware Acceleration
Io_uring by Example
unixism.net·19h·
Discuss: Hacker News
💫IO_uring
I wrote a calculator to estimate token generation speeds for MoE models
jamesyc.github.io·17h·
Discuss: r/LocalLLaMA
💾Prompt Caching
I’ve been working on something new:
threadreaderapp.com·3h
🪄Prompt Engineering
GPUPrefixSums – state of the art GPU prefix sum algorithms
github.com·4h·
Discuss: Hacker News
⚙️Mechanical Sympathy
the annotated transformer (2022) | hacker news
news.ycombinator.com·11h·
Discuss: Hacker News
🧠LLM Inference
Compilation vs. vectorization, search engine edition
jpountz.github.io·3h·
Discuss: Hacker News
🔍Query Optimization
Curriculum Training for Physics-Informed PIC Code Surrogates
haydenramm.bearblog.dev·19h
⚛️Physics
AMD details how it built a product line-up with just two RDNA 4 dies — Flexible design and asymmetric harvesting enables production of multiple models without n...
tomshardware.com·5h
🖥GPUs
Finetune and deploy GPT-OSS in MXFP4: ModelOpt+SGLang
lmsys.org·17h
🧠LLM Inference
Intel Xe-HPG Architecture (2022)
intel.com·23h·
Discuss: Hacker News
⚡Hardware Acceleration
Explaining the Need for Strongly Happens Before in C++
nekrozqliphort.github.io·14h·
Discuss: Hacker News, r/cpp
🔄Cache Coherence
I was wrong about tidymodels and LLMs
simonpcouch.com·5h·
Discuss: Hacker News
🏆LLM Benchmarking
Evaluating image segmentation models for background removal for Images
blog.cloudflare.com·3h
🔍AI Interpretability
Posts Perseverance – A History of Manifold
elalish.blogspot.com·12h·
Discuss: Hacker News
🔓Open Source Software