Speculative Decoding

Feeds to Scour
SubscribedAll
Scoured 27 posts in 6.3 ms

harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.

 ⚡Continuous Batching  Content type: Code
github.com··Hacker News

The economics of speculative decoding

 🚀LLM Deployment  Content type: Blog
fergusfinn.com··Hacker News

A system programmer’s guide to LLM inference

 ⚡Continuous Batching  Content type: Blog
blog.xiangpeng.systems··Hacker News

AdaPLD: Adaptive Retrieval and Reuse for Efficient Model-Free Speculative Decoding

 🚀LLM Deployment  Content type: Academic
arxiv.org·

MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 TPS

 ⚡Quantization  Content type: Blog
mimo.xiaomi.com··Hacker News, r/LocalLLaMA

Making LLMs faster and more efficient across multiple languages

 🚀LLM Deployment
techxplore.com·

Nutrient control enables metabolic reconstruction of L. rhamnosus GG and analysis of secretions

 ⚡Quantization  Content type: Academic
biorxiv.org·

BeeLlama.cpp DFlash on Strix Halo: 2.7x Gemma 31B, But MTP Is Still Faster

 💻Local AI
sleepingrobots.com·

China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude (4 minute read)

 ⚡Quantization  Content type: News
decrypt.co·

Making Local LLM Go Brrr

 💻Local AI
seanpedersen.github.io·

LLM Research Papers: The 2026 List (January to May)

 🗣️NLP  Content type: News
magazine.sebastianraschka.com
··Hacker News

Speculators v0.5.0: DFlash support and online training

 🚀LLM Deployment
developers.redhat.com·
Less-relevant results

Here's a llama.cpp CLI Command builder.

 🔓Open Source AI
llamabuilding.com··r/LocalLLaMA

Part 3 — Implementation/Engine-Level: Choosing the Runtime That Gives You These for Free

 ⚡Continuous Batching
towardsai.net·

defai-digital/ax-engine: Apple Silicon LLM runtime supporting Gemma 4 and Qwen 3.6 MTP modes

 🔓Open Source AI  Content type: Code
github.com··Hacker News

Nvidia Nemotron 3 Ultra

 🗣️NLP
research.nvidia.com··Hacker News

Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!

 ⚡Quantization
gizchina.com·

MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better

 ⚡Quantization  Content type: News  Content type: Blog
kaitchup.substack.com··r/LocalLLaMA

What Arm-based innovations happened in May 2026?

 💻Local AI  Content type: Blog
newsroom.arm.com·

3x Faster Search: Parallel Test-Time Scaling with Instructed-Retriever-1

 📊Retrieval Evaluation  Content type: Blog
databricks.com·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help