I Built Speculative Decoding from a scratch— Here’s What Actually Broke

💲 Paywalled: This content may require a subscription. Manage paywalled content settings on Scour.

An honest account of building FlashSpec: an adaptive LLM inference engine with a Triton kernel and online bandit draft selection.

View Post on Scour ↗

More from medium.com on Scour.