Good results fine tuning a local LLM like Qwen 3:0.6B to categorize questions (opens in new tab)

If you are going to go to the bother of fine tuning for trivial problems like subject classification then I think you'll find Scikit Learn with a SGDClassifier on 2-grams will do probably just as well and be under 1MB for the trained classifier.