Benchmarking LLM Inference on RTX 4090 / RTX 5090 / RTX PRO 6000 #2
reddit.com·9h·
Discuss: r/LocalLLaMA
🏗️LLM Infrastructure
Assuring Agent Safety Evaluations By Analysing Transcripts
lesswrong.com·17h
🏆LLM Benchmarking
AAS: The Metric for Monitoring DB Performance
kylehailey.com·17m·
Discuss: Hacker News
📊Database Profiling
OBCache: Optimal Brain KV Cache Pruning for Efficient Long-Context LLM Inference
arxiv.org·23h
🧠LLM Inference
Building a Scalable QA Automation Strategy: The 90-Day Roadmap
codemeetscapital.bearblog.dev·10h
👨‍💻Software development practices
Supercharge your Enterprise BI: How to approach your migration to AI/BI
databricks.com·6h
🏗️Infrastructure Economics
MECE — The AI Principle You’ll Never Stop Using After Reading This
pub.towardsai.net·16h
🔍AI Interpretability
simplicity • Pragmatic Dave Thomas & Sarah Taraporewalla
buzzsprout.com·9h·
Discuss: r/programming
⚡Developer Experience
InferenceMAX – open-source Inference Frequent Benchmarking
github.com·7h·
Discuss: Hacker News
🏗️LLM Infrastructure
Tracking AI product usage without exposing sensitive data
rudderstack.com·1h·
Discuss: r/programming
📊Feed Optimization
When Python can't thread: a deep-dive into the GIL's impact
pythonspeed.com·15h·
Discuss: Hacker News
🧵Concurrency
Operable Software
ferd.ca·13h·
Discuss: Hacker News
🌐Distributed systems
Can AI Co-Design Distributed Systems? Scaling from 1 GPU to 1k
harvard-edge.github.io·5h·
Discuss: Hacker News
🌐Distributed systems
InferenceMax AI benchmark tests software stacks, efficiency, and TCO — vendor-neutral suite runs nightly and tracks performance changes over time
tomshardware.com·7h
🖥GPUs
Let's Write a Macro in Rust
hackeryarn.com·11h·
Discuss: Hacker News
🎭Rust Macros
Scaling Time-Series Data for AI Models
singlestore.com·12h
🎛️Feed Filtering
VLLM Predicted Outputs
cascadetech.ai·6h·
Discuss: Hacker News
🏗️LLM Infrastructure
How different AI engines generate and cite answers
searchengineland.com·15h
📊Feed Optimization
Show HN: I made a Google Analytics alternative that's easy and user-friendly
statflows.com·1h·
Discuss: Hacker News
🚀Web Performance
From Toil to Empowerment: Building Self-Service Ingress with GitOps
usenix.org·23h
🌐Distributed systems