Looking for backdoors in Jane Street LLMs (opens in new tab)

I am going to talk about my experience in the Jane Street LLM backdoor challenge. I am sharing partial results. I managed to crack some of the models using white-box methods, after the activation/prompting approach didn't pan out. Happy to discuss better or more promising approaches.IntroductionA few months ago a Dwarkesh Patel podcast episode advertised a Jane Street backdoor challenge:We've trained backdoors into three language models.On the surface, they behave like ordinary conversational...