Back to article

[Speculative decoding] feat: add EAGLE3 speculative decoding support by ichbinhandsome · Pull Request #18039 · ggml-org/llama.cpp (opens in new tab)

Covered by 3 sources including latent.space, news.smol.aiDiscussed on r/LocalLLaMA and r/LocalLLaMA

Covered in 3 articles

[AINews] Fable and Mythos officially too dangerous to release

not much happened today | AINews

In other languages

Qwen3.6 MTP весит на 0.3 Гб больше, а даёт ускорение в ~2 раза. С 60 t/s до 130 t/s для Qwen3.6 27B без искажений