Training nanoGPT on Slurm with a Nix-Pinned Environment (opens in new tab)

This article describes a pattern for creating reproducible runtime environments for ML/AI using declared, graph-backed environments based on Nix and Flox. The same Nix and Flox environments run as-is during both model training in local dev to checkpoint validation in eval.