Pretraining on unlabeled data in Elixir (opens in new tab)

Pretraining on unlabeled data in Elixir 3 Jun 2026 by karlosmid Here is my latest post on building llm from scratch in Elixir, Pre-training on unlabelled data in Elixir: calculating generation loss, training on The Verdict story, controlling decoding with temperature and top-k sampling, saving checkpoints, and loading OpenAI GPT-2 weights.