Profile(v2.1.4) physics-aware optimizer for vLLM (31→470 tok/s on A100) (opens in new tab)

Discussed on Hacker News

A physics-grounded, cost-aware optimizer for vLLM. - jungledesh/profile

Read the original article

Sign in to keep reading the full article.