You Can’t Monitor an AI Agent Like a Web Service. Here’s What I Track Instead. (opens in new tab)

The uptime, the error rate, the p95 latency you get for free — they cover exactly the dimensions where agents don’t fail, and stay silent on the ones where they do\. Web monitoring was built for web services\. Agents fail silently, return 200 OK, and burn tokens\. Here are the metrics that actually catch it\. The Failure That Doesn’t Page Anyone The worst production incident I’ve had with an agent never triggered an alert\. No 500s\. No latency spike\. No error rate climbing on a dashboard\. ...