vLLM Performance Tuning: The Ultimate Guide to xPU Inference Configuration
cloud.google.com·7h
📱Edge AI Optimization
Fast Reasoning on GPT-OSS with Speculative Decoding and Arctic Inference
snowflake.com·23h
🧠LLM Inference
OpenAI: Building the "Everything Platform" in AI
leoniscap.com·4h·
Discuss: Hacker News
🖥GPUs
Fast and Accurate RFIC Performance Prediction via Pin Level Graph Neural Networks and Probabilistic Flow
arxiv.org·19h
📊Vector Databases
A Big Step Forward to Limit AI Power Demand
semiwiki.com·10h
⚡Hardware Acceleration
The Research Imperative: From Cognitive Offloading to Augmentation
pub.towardsai.net·11h
🪄Prompt Engineering
Powerful GPUs or Fast Interconnects: Analyzing Relational Workloads
vldb.org·1h·
Discuss: Hacker News
📊Database Benchmarking
Import AI 426: Playable world models; circuit design AI; and ivory smuggling analysis
importai.substack.com·10h·
Discuss: Substack
🆕New AI
NVFP4 Trains with Precision of 16-Bit and Speed and Efficiency of 4-Bit
developer.nvidia.com·23h·
Discuss: Hacker News
🔢BitNet Inference
2025 Spending On AI To Hit $644 Billion But 2024 AI Revenue Only $45 Billion
thelowdownblog.com·8h·
Discuss: www.thelowdownblog.com
🖥GPUs
just pushed my first multi-turn RL environment to @PrimeIntellect
threadreaderapp.com·23h
🕯️Candle
AI systems are great at tests. But how do they perform in real life?
techxplore.com·8h
🏆LLM Benchmarking
Enterprise essentials for generative AI
infoworld.com·14h
🏆LLM Benchmarking
AWS Noob here: EC2 vs SageMaker vs Bedrock for fine-tuning & serving a custom LLM?
reddit.com·8h·
Discuss: r/LocalLLaMA
🖥GPUs
Notes on Autograd
aschrein.github.io·4h·
Discuss: Hacker News
🧮Compute Optimization
Elon Musk doubles down on goal of 50 million H100-equivalent GPUs in the next 5 years — Envisions billions of GPUs in the future as Grok 2.5 goes open source
tomshardware.com·8h
🖥GPUs
Intel Collaborates with LG Innotek to Implement an AI-powered Smart Factory
newsroom.intel.com·8h
⚡Hardware Acceleration
AMD Threadripper 9980X 64-Core CPU Review & Benchmarks
gamersnexus.net·2h
⚙️Mechanical Sympathy
Can large language models figure out the real world?
news.mit.edu·2h
🔍AI Interpretability
Nvidia Will Put the AI Stocks Frenzy to the Test
bloomberg.com·13h
🖥GPUs