LLM Optimization Notes: Memory, Compute and Inference Techniques
gaurigupta19.github.io·9h·
Discuss: Hacker News
💻Local LLMs
Learning to Route: A Rule-Driven Agent Framework for Hybrid-Source Retrieval-Augmented Generation
arxiv.org·21h
🔍Information Retrieval
Troops Head to Chicago, Despite Efforts to Block Them
nytimes.com·3h
📡RSS
Chat Smarter, Not Harder: Building an AI Chat Interface in Your Angular App
dev.to·3h·
Discuss: DEV
🔌Interface Evolution
Beating the L1 cache with value speculation (2021)
mazzo.li·9h·
Discuss: Lobsters
⚡CPU Microarchitecture
Is Odin Just a More Boring C?
dayvster.com·14h·
Discuss: Hacker News
🔩Systems Programming
Achieving 1.2 TB/s Aggregate Bandwidth by Optimizing Distributed Cache Network
juicefs.com·1d·
Discuss: Hacker News
📡Network Stack
Eliminating the Precision–Latency Trade-Off in Large-Scale RAG
thenewstack.io·3d
🎯Retrieval Systems
LibreQoS v1.5-RC-2
libreqos.io·4h
🔌Interface Evolution
Introducing OpenZL: An Open Source Format-Aware Compression Framework
engineering.fb.com·9h·
Discuss: Lobsters, Hacker News, r/programming
⚡Modern Compression
A Global Mining Dataset
tech.marksblogg.com·14h·
Discuss: Hacker News
📦METS Containers
Token economics are serious AI business; API costs are out of control
theservitor.com·16h·
Discuss: Hacker News
🌀Brotli Internals
Self-Extracting F3
buttondown.com·7h·
Discuss: Hacker News
✅Format Verification
Measuring scaleup for Postgres 18.0 with sysbench
smalldatum.blogspot.com·1d·
Discuss: smalldatum.blogspot.com
📊Performance Profiling
Database Transactions: Everything That Can Go Wrong When Using Them
hackernoon.com·3h
📝Database WAL
Show HN: I Built a Transcription CLI Because Uploading 4GB Videos Was Killing Me
medium.com·6h·
Discuss: Hacker News
💿FLAC Archaeology
Krish Naik: Complete RAG Crash Course With Langchain In 2 Hours
dev.to·5h·
Discuss: DEV
📊Multi-vector RAG
Property-based testing of batch-invariant operations
mmaaz.ca·1d·
Discuss: Hacker News
🧪Property-Based Testing
We built an open source SLURM replacement for ML training workloads built on SkyPilot, Ray and K8s.
reddit.com·6h·
Discuss: r/kubernetes
🌊Streaming Systems
An Overview of Modern Memory Management Architectures in LLM Agents
vinithavn.medium.com·1d·
Discuss: Hacker News
💾Persistence Strategies