33 LLM metrics to watch closely (opens in new tab)

We’ve all heard the mantra from the quants in the business community: you can’t manage what you can’t measure. And if that’s true for human intelligence, it should be true for the too. How do we measure (LLMs)? We’re just beginning to come up with statistical metrics. Here are several of the most common metrics that designers and users toss about when they’re evaluating a model. [ See also: ] Time to first token How long does it take to generate the first token? For real-time applications wit...