Running Gemma 4 Inside a Docker Container with GPU Passthrough (opens in new tab)

This is a submission for the Gemma 4 Challenge: Write About Gemma 4 Here's a situation every ML team eventually hits. Your intern gets Gemma 4 running locally. Beautiful. Fast. Impresses the standup. Then they leave for the semester. Three weeks later, nobody can reproduce the setup. The model was in a path that no longer exists. The Python version was wrong. The CUDA libraries conflicted with PyTorch. Someone pip installed something globally and broke everything. This is why Docker exists. A...