BrunoArsioli/llama-optimus: Lightweight Python tool using Optuna for tuning llama.cpp flags: towards optimal tok/s for your machine (opens in new tab)

Covers pypi.org - 605.5 kbDiscussed on r/LocalLLaMA

Lightweight Python tool using Optuna for tuning llama.cpp flags: towards optimal tok/s for your machine - BrunoArsioli/llama-optimus

Read the original article

Sign in to keep reading the full article.