On “Model Organisms” (opens in new tab)

This post was written while working for Arcadia Impact's Alignment Team (and grew out of an internal talk I gave) but is my own opinion and not theirs. I am grateful for feedback from Daniel Tan and the rest of the team.This post was originally going to be more heavily about “model organisms” in AI safety research. But Francis Rhys Ward already wrote an excellent [1]TL;DR what are you studying? Are you studying a production language model in order to infer things about how language models beh...