What breaks when you ask an LLM for JSON (288 model outputs tested) (opens in new tab)

I tested structured output from 288 real model calls across every major provider, and what I found changed how I build things. There's a moment in every LLM integration project where you write json.loads(response) for the first time and it works, and you think the whole thing is