Cutting LLM Batch Inference Time in Half: Dynamic Prefix Bucketing at Scale
daft.ai·2h·
Discuss: Hacker News
🔀Parallel Computing
Flag this post
Don't let these 3 CPU specs trick you into paying more
xda-developers.com·1d
🚀Performance
Flag this post
On Designing Low-Latency Systems for High-Traffic Environments
hackernoon.com·1d
🚀Performance
Flag this post
Why is AI Generated Rust slow when compared with Go/C#/Node/JavaScript
srid68.github.io·5h·
Discuss: Hacker News
🚀Performance
Flag this post
Inside Pinecone: Slab Architecture
pinecone.io·3h·
Discuss: Hacker News
🚀Performance
Flag this post
1 billion JSON records, 1-second query response: Apache Doris vs. ClickHouse, Elasticsearch, and PostgreSQL
dev.to·41m·
Discuss: DEV
🚀Performance
Flag this post
Attention Is All You Need for KV Cache in Diffusion LLMs
paperium.net·15h·
Discuss: DEV
🧠Memory Management
Flag this post
Moving past speculation: How deterministic CPUs deliver predictable AI performance
venturebeat.com·2d
🔀Parallel Computing
Flag this post
DCcluster-Opt: Benchmarking Dynamic Multi-Objective Optimization for Geo-Distributed Data Center Workloads
arxiv.org·15h
🚀Performance
Flag this post
Low-Level Hacks
blog.raycursive.com·17h·
Discuss: Hacker News
🔧Systems Programming
Flag this post
My First Multi-GPU Kernel: Writing All-to-All for AMD MI300X
gau-nernst.github.io·1d·
Discuss: Hacker News
🔀Parallel Computing
Flag this post
Running MiniMax-M2 locally - Existing Hardware Advice
reddit.com·3h·
Discuss: r/LocalLLaMA
🚀Performance
Flag this post
Parallel achieves 70% accuracy on SEAL, benchmark for hard web research
parallel.ai·55m·
Discuss: Hacker News
🚀Performance
Flag this post
Free Functions Don't Change Performance (Much)
16bpp.net·1d·
Discuss: Hacker News, r/cpp
🚀Performance
Flag this post
Show HN: Polyglot standard library HTTP client C/C++/Rust/Python and benchmarks
github.com·15h·
Discuss: Hacker News
🌐Network Protocols
Flag this post
Benchmarking the cost of Java's EnumSet - A Second Look
kinnen.de·42m·
Discuss: r/programming
🚀Performance
Flag this post
Algorithmic Complexity Reduction via Quantized State Space Search
dev.to·2h·
Discuss: DEV
🚀Performance
Flag this post
H-FA: A Hybrid Floating-Point and Logarithmic Approach to Hardware Accelerated FlashAttention
arxiv.org·15h
🚀Performance
Flag this post
Lazy loading isn't the magic pill to fix AI Inference
tensorfuse-docs.mintlify.dev·5h·
Discuss: Hacker News
🚀Performance
Flag this post
How Datadog Built a Custom Database to Ingest Billions of Metrics Per Second
blog.bytebytego.com·4h
🚀Performance
Flag this post