Tokens Are Cheap, Wrong Answers Aren’t (opens in new tab)

Covered by DEV Community

I priced eight local LLMs by the only number that matters in the end — euro-cents per 1,000 correct answers — on one RTX 3090, billed at…

Read the original article

Sign in to keep reading the full article.

Covered in 1 article

DEV Community·

How to Rank Local LLMs by Cost per Correct Answer (Measured GPU Energy, 8 Ollama Models)

Discussed on DEV