Breaking Browser-Use Models Using Domain Randomization (opens in new tab)

Original Model Result ✓ Correct ✕ Precision Variant (70% zoom) Model Result ✗ Clicked on fake 'View Deal' ad ✕ Figure 1: Sample: 21 of 390: "Click on 'View Deal' button for flight '#2125, #2126'", Direct Instruction, No Reasoning. Result: UI-TARS1.5-7B clicked on the fake 'view deal' button in the ads