Fine Tuning a Tiny Local LLM to Categorize Questions (opens in new tab)

As a fun personal project, I have been working on a chatbot for answering general questions about my household on anything from maintenance questions to doctor’s appointments. The general idea is that the chatbot will get its household knowledge through RAG from querying a vector database, but for better results I have made the vector searches metadata aware. Basically, I am running questions through a pre-processing step to categorize questions into known metadata categories (e.g. pool, car,...