How to Stop Shipping Low-Quality RL Environments (with Examples) (opens in new tab)

Your broken harness is actively making the model worse. Here's what I keep seeing after years of eyeballing trajectories, and what you need to fix.