Gemma 4 Multi-Token Prediction Delivers Up to ~3x Faster Token Generation (opens in new tab)

Gemma 4 can be paired with multi-token prediction (MTP) drafters that use speculative decoding to generate multiple tokens in parallel, allowing the model to verify them in a single pass and achieve up to ~3× faster inference without quality loss.