Back to article

llama + spec: MTP Support by am17an · Pull Request #22673 (opens in new tab) 10 articles covering this post

github.com··Hacker News, r/LocalLLaMA·Open original

Covered in 10 articles

Doubling Qwen3.6-27B on One RTX 3090: ollama llama.cpp + MTP, Lever by Lever (35.7 80.2 tok/s)

Three Months of Speed-Up Experiments on a 3090 Ti: Autoregressive DFlash MTP for Qwen3.6-27B

froggeric/Qwen3.6-27B-MTP-GGUF

huggingface.co··DEV

Used over a million tokens in three separate sessions to test Qwen 3.6 35b (new Multi-token Prediction version)

huggingface.co··r/LocalLLaMA

Benchmarking llama.cpp's brand-new MTP support on Strix Halo

calebcoffie.com··Hacker News

Multi Token Prediction in llama.cpp

am17an.bearblog.dev·

This Month in Agentic Coding – May 2026

agenticcodingweekly.com··Hacker News, Hacker News

AI's Plummeting Prices Are a Software Story, Not a Hardware One

weightythoughts.com··Hacker News

MTP Isn't Always a Win: 1.95x on My 3090, but Speculative Decoding Is Hardware-Dependent

bric.pe.kr··DEV

In other languages

Qwen3.6 MTP весит на 0.3 Гб больше, а даёт ускорение в ~2 раза. С 60 t/s до 130 t/s для Qwen3.6 27B без искажений