Speculative Decoding

Feeds to Scour
SubscribedAll
Scoured 117 posts in 7.9 ms

ViaTunisia subsea segment reaches ready-for-service status

 🐝eBPF  Content type: News
computerweekly.com
·

Token4Token — pay-per-token inference on Gnosis + Swarm

 🧠Inference Engineering
t4t.eth.link··Hacker News

Making Local LLM Go Brrr

 ⏱️Prefill Decoding
seanpedersen.github.io·

PagedAttention vs Traditional KV Cache: How vLLM Reinvented GPU Memory for LLM Inference

 ⏱️Prefill Decoding  Content type: Blog
medium.com
·

How to Run Gemma 4 12B Locally - The Best AI For Consumer Laptops

 🧠Inference Engineering  Content type: Video
youtube.com·

Here's a llama.cpp CLI Command builder.

 🗜️Quantization
llamabuilding.com··r/LocalLLaMA

AdaPLD: Adaptive Retrieval and Reuse for Efficient Model-Free Speculative Decoding

 🗜️Quantization  Content type: Academic
arxiv.org·

huawei-csl/KVarN: KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.

 💾KV Cache  Content type: Code
github.com··Hacker News

Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!

 💰Inference Cost
gizchina.com·

How we fight GPU scarcity without compromise

 💾KV Cache  Content type: Blog
equixly.com··Hacker News

DiffusionGemma: 4x Faster Text Generation

 🧠Inference Engineering  Content type: News  Content type: Blog
blog.google··Hacker News, r/LocalLLaMA, r/singularity

Youssof Altoukhi (@Youssofal_)

 🧠Inference Engineering
xcancel.com··r/LocalLLaMA

Photo Friday: Our valiant steeds

 ⚡FlashAttention
ggwash.org·

OpenPCC: Open and Confidential LLM Serving on Commodity TEEs

 🧠Inference Engineering  Content type: Academic
arxiv.org·

Castlevania: Belmont's Curse release date confirmed on October 15, Japanese voice cast list also revealed

 🧵Warp Scheduling
rpgsite.net·

harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.

 💾KV Cache  Content type: Code
github.com··Hacker News

Google Shrank Gemma 4 by 72% and Unsloth Fixed the 4-Bit Bug Nobody Else Caught on One 4090, and 4-Bit Shouldn’t Be This Good

 💰Inference Cost  Content type: Blog
towardsai.net·

Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation

 💰Inference Cost  Content type: Academic
arxiv.org·

Running LLM Inference on Kubernetes: What It Actually Takes

 🧠Inference Engineering  Content type: Blog
fairwinds.com·

Latest technical articles & videos.

 🧠Inference Engineering
certdepot.net·

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help