Reasoning RL in 2026: GRPO, DPO, RLVR, Agentic PO & Beyond (opens in new tab)

From GRPO and DPO to DAPO, GSPO, ARPO, Vector PO, and new preference optimization methods – a compact guide to the reinforcement learning techniques shaping reasoning models in 2026