Ninety-one percent accurate is not what it sounds like (opens in new tab)

The April 2026 New York Times commission of Oumi to test Google's AI Overviews against the SimpleQA benchmark produced two numbers that were widely reported and one that mostly was not. The widely reported numbers: 85% accuracy on Gemini 2 in the AI Overview slot, 91% on Gemini 3. Roughly one in ten answers wrong, in headlines from TechSpot, Futurism, Newsweek, BigGo, TechRepublic, Breitbart, Computing.co.uk, Newsbytes, Algorythmic, and DigitalToday. The number that mostly didn't make the hea...