Optimal Scheduling Algorithms for LLM Inference: Theory and Practice
arxiv.org·5h
🧠LLM Inference
What Would the Aftermath of the AI Bust Look Like?
thediff.co·18h·
Discuss: Hacker News
🆕New AI
Import AI 423: Multilingual CLIP; anti-drone tracking; and Huawei kernel design
jack-clark.net·23h
🆕New AI
Hessian analysis with JAX: a platform-agnostic, high-performance approach
lesswrong.com·4h
🕯️Candle
The Revolution of Token-Level Rewards
levroai.com·18h·
Discuss: Hacker News
🏆LLM Benchmarking
AI Clouds Are Flying Blind: The Illusion of Runtime Protection
thenewstack.io·14h
🖥GPUs
How LLMs See the World
blog.bytebytego.com·17h
🧠LLM Inference
How MLB keeps fans connected to the game – one cache hit at a time
cloud.google.com·17h
🖥GPUs
Simulated Society of 10k AI Agents
theunwindai.com·17h·
Discuss: Hacker News
🆕New AI
Towards American Truly Open Models: The ATOM Project
interconnects.ai·18h
🤖AI
OpenAI Is Winning the AI Race, But Losing the Business Game
hackernoon.com·16h
🖥GPUs
One of the first things I was looking for when I got into dspy was to combine it with offline vllm batch inference.
threadreaderapp.com·10h
🕯️Candle
The future of AI in Finance: Insights from Nubank’s Tech Leaders at Purple MinDS
building.nubank.com·15h
🏆LLM Benchmarking
SAT Requires Exhaustive Search
link.springer.com·12h·
Discuss: Hacker News
🧮SMT Solvers
How I turned a general-purpose LLM into a professional code optimization expert with one detailed prompt
reddit.com·23h·
Discuss: r/programming
🪄Prompt Engineering
On SP1’s Precompiles
mycelias.xyz·5h
⚙️Language Runtimes
Snowflake and Databricks vie for the heart of enterprise AI
nordot.app·23h
🖥GPUs
Mithril launches omnicloud for compute and batch inference
mithril.ai·14h·
Discuss: Hacker News
🖥GPUs
Lessons from Amazon S3 Vector Store and the Nuances of Hybrid Vector Storage
caylent.com·18h·
Discuss: Hacker News
🏗️Search Infrastructure
BOOST: Bayesian Optimization with Optimal Kernel and Acquisition Function Selection Technique
arxiv.org·5h
📊Statistical Ranking