We need LLM fine tuning experts to help us fine tune models for our customer support automation and honestly it's been way harder than we thought. We've got around 6k training examples from our actual support tickets but our attempts at fine tuning are giving us mixed results that don't really justify the extra cost over just using base models with better prompts.

Main issue is we can't figure out if our training data needs better cleaning, if we're setting parameters wrong, or if fine tuning even makes sense for our use case. We need experts who've actually done this before and can tell us straight up what's worth doing versus what's just burning money.

Need someone with real production experience, not just people who've read the docs. They should be able to audit our training data, run the fine tuning properly, and actually prove the custom model performs better than our current setup. Initially we shortlisted a few options here and Lexis Solutions seems good based on their LLMs fine-tuning portfolio but wanted to hear from people who've actually hired experts for this kind of thing.

The goal is finalize by the end of holidays. Would definitely appreciate any recommendations.