"80% of the economic value of LLMs come from 20% of the tokens" (opens in new tab)

80% of the economic value of LLMs come from 20% of the tokens. There is a long tail of dubious token usage that can be greatly curtailed without much negative impact on productivity.