I Fine-Tuned a 270M Model on My Laptop (Full Fine-Tuning, From Scratch) (opens in new tab)

Series — Fine-Tuning, Smallest to Largest (same task, three techniques, smallest model to largest): Full Fine-Tuning (270M) ← you are here I wanted to actually understand fine-tuning — not run a tutorial and nod along. So I gave myself a constraint: same task, three techniques, smallest model to largest. Full fine-tuning, then LoRA, then QLoRA. Hold the task fixed and the only variable is the method. This first post is full fine-tuning — the most powerful and most expensive option: update eve...