The frontier for economic value from AI agents is non-gullibility (opens in new tab)

The usual measures of AI progress have not suited my lived experience for some time now: One measure is “maximum length of human task that AI can complete.” The ideal goal here seems to be AI developing ever larger software systems, like browsers. Another measure is “key reasoning breakthroughs,” like proving some math theorem or finding zero-days. The ideal goal here seems to be the Riemann hypothesis. I think both are worthwhile goals. But in my day job doing enterprise software development...