New Anthropic Fellows research: Model Spec Midtraining (MSM). (opens in new tab)
New Anthropic Fellows research: Model Spec Midtraining (MSM). Standard alignment methods train AIs on examples of desired behavior. But this can fail to generalize to new situations. MSM addresses this by first teaching AIs how we would like them to generalize and why.
Read the original article