Back to article
lmsys.org

DFlash and Spec V2 Decoding (14 minute read) (opens in new tab)

Covers 5 stories See all stories this covers including Looking for a self-hosted alternative to Modal.com for running ML workloadsDiscussed on Hacker News

Covers 5 related stories

Modal Blog·

Looking for a self-hosted alternative to Modal.com for running ML workloads

Discussed on r/selfhosted
Feeds
mimo.xiaomi.com·

MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 TPS

Discussed on Hacker News and r/LocalLLaMA
Feeds
blog.google·

Accelerating Gemma 4: faster inference with multi-token prediction drafters

Discussed on Hacker News
Feeds
arxiv.org·

[2211.17192] Fast Inference from Transformers via Speculative Decoding

Feeds
arxiv.org·

EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test

Feeds

Keyboard Shortcuts

Navigation

Next / previous post
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Discover
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help