Cutting LLM Batch Inference Time in Half: Dynamic Prefix Bucketing at Scale
daft.ai·2h·
Discuss: Hacker News
🔄Concurrency
Flag this post
Why is AI Generated Rust slow when compared with Go/C#/Node/JavaScript
srid68.github.io·4h·
Discuss: Hacker News
🌐WebAssembly
Flag this post
Don't let these 3 CPU specs trick you into paying more
xda-developers.com·1d
🔄Concurrency
Flag this post
How to Build an Enterprise AI Benchmarking Framework?
dev.to·22h·
Discuss: DEV
🌐WebAssembly
Flag this post
On Designing Low-Latency Systems for High-Traffic Environments
hackernoon.com·1d
🔄Concurrency
Flag this post
Free Functions Don't Change Performance (Much)
16bpp.net·1d·
Discuss: Hacker News, r/cpp
🔄Concurrency
Flag this post
Running MiniMax-M2 locally - Existing Hardware Advice
reddit.com·3h·
Discuss: r/LocalLLaMA
🌐WebAssembly
Flag this post
Inline vs. Pipeline Ray Tracing
evolvebenchmark.com·6h·
Discuss: Hacker News
🔄Concurrency
Flag this post
Lazy loading isn't the magic pill to fix AI Inference
tensorfuse-docs.mintlify.dev·5h·
Discuss: Hacker News
🌐WebAssembly
Flag this post
Inside Pinecone: Slab Architecture
pinecone.io·3h·
Discuss: Hacker News
🗄️Database Design
Flag this post
Benchmarking the cost of Java's EnumSet - A Second Look
kinnen.de·38m·
Discuss: r/programming
🔄Concurrency
Flag this post
Essential Things to Know Before Upgrading Your Computer Memory
buysellram.com·1d·
Discuss: Hacker News
🌐WebAssembly
Flag this post
Disciplined Biconvex Programming
arxiv.org·15h
🔄Concurrency
Flag this post
Parallel achieves 70% accuracy on SEAL, benchmark for hard web research
parallel.ai·51m·
Discuss: Hacker News
🔄Concurrency
Flag this post
Attention Is All You Need for KV Cache in Diffusion LLMs
paperium.net·15h·
Discuss: DEV
🔄Concurrency
Flag this post
My First Multi-GPU Kernel: Writing All-to-All for AMD MI300X
gau-nernst.github.io·1d·
Discuss: Hacker News
🔄Concurrency
Flag this post
Algorithmic Complexity Reduction via Quantized State Space Search
dev.to·2h·
Discuss: DEV
🔄Concurrency
Flag this post
Balancing Cost, Power, and AI Performance
oreilly.com·1h
🔌API Development
Flag this post
eBPF Tutorial by Example: Monitoring GPU Driver Activity with Kernel Tracepoints
dev.to·12h·
Discuss: DEV
🔄Concurrency
Flag this post
Moving past speculation: How deterministic CPUs deliver predictable AI performance
venturebeat.com·2d
🔄Concurrency
Flag this post