Inference Arbitrage: How I Route 200+ Daily LLM Calls Across Five Models (opens in new tab)

Inference arbitrage means routing each AI task to the cheapest model that can handle it at acceptable quality, instead of sending everything to the most expensive one. No benchmark tells you which model to use for which task at which price point. I published a 38-task benchmark across 15 models last week and the top finding was a routing principle, not a model name: match the model to the task, and most of your tasks don't need the expensive one. What Does My AI Workday Look Like? I was on a ...