A green test suite proves less than you think (opens in new tab)

A green test suite proves less than you think The test that scared me was the one that passed. I had an integration test for a routing agent, the kind that takes a task and picks a capability to handle it. The test registered a new capability at runtime and then checked that the router would eventually route to it. Green run after run. Solid. I trusted it. Then I read it properly. It reused the same task string on every iteration of the loop. My scorer was deterministic by design, it hashed t...