Introducing AutomationBench (opens in new tab)

Today we're releasing AutomationBench, an open benchmark that measures whether AI models can complete real business workflows. Current model evaluations tell you whether an LLM can answer math olympiad questions, write code, or reason through a logic puzzle. Those are important, but they don't tell you the thing that matters most to enterprises: whether it can get work done. As in, find the right CRM records, send the right follow-up, update the right systems, and get to a verifiable end state w