Mixture of Experts

Feeds to Scour
SubscribedAll
Scoured 95 posts in 7.0 ms

Redesign Mixture-of-Experts Routers with Manifold Power Iteration

 ⚡Inference Optimization  Content type: Academic
arxiv.org·

The economics of speculative decoding

 ⚡Inference Optimization  Content type: Blog
fergusfinn.com··Hacker News

Why the Smartest AI Models Don’t Use Their Entire Brain: Understanding Mixture of Experts (MoE)

 ⚡Inference Optimization  Content type: Blog
medium.com
·

Introducing Piper: A Programmable Distributed Training System

 ⚡CUDA  Content type: Academic  Content type: Blog
Less-relevant results

Dr. Ashish Bamania (@drashishbamania)

 🔄Transformers
substack.com··Substack

Cohere open-sources a coding agent that runs on a single H100

 🤖agentic system
venturebeat.com·

Luce Spark: a 35B MoE on a 16 GB GPU, without the offload tax

 ⚡Inference Optimization  Content type: Blog
lucebox.com··Hacker News

The Memory Problem is Solved: How Google’s Memory Caching Makes RNNs Smart Again

 🔄Transformers  Content type: Blog
medium.com·

Introducing North Mini Code: Cohere’s First Model For Developers

 🔄Transformers  Content type: Blog
huggingface.co··Hacker News

EnzOracle: Mechanism-aware prediction of enzyme environmental adaptation via a classification-guided mixture-of-experts framework

 🔄Transformers  Content type: Academic
biorxiv.org·

CommBench: Can LLMs Write Correct and Efficient GPU Communication Code?

 ⚡CUDA

"North Mini Code"; open weights, 30B param, Canadian coding model

 🔄Transformers  Content type: Blog
cohere.com··Hacker News

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

 ⚡Inference Optimization

Google’s DiffusionGemma is 4x faster than its other Gemma models

 ⚡Inference Optimization
thenewstack.io·

DiffusionGemma: 4x Faster Text Generation

 🔄Transformers  Content type: News  Content type: Blog

Achieving Cloud-Grade SLOs for Local Mixture-of-Experts Inference through CPU-GPU Hybrid Design

 ⚡Inference Optimization  Content type: Academic
arxiv.org·

Burning 2.1M Tokens Version of Misadventures in Vibe-Programming: LAUGH OF THE DAY

 🔄Transformers
substackcdn.com··Substack

Transitioning from Azure Language Features to Foundry Models

 🔧MLIR
techcommunity.microsoft.com
·

Anatomy of a high-performance EP kernel

 ⚡Inference Optimization  Content type: Blog
fergusfinn.com··Hacker News

The Clock Said Valid. The World Said Otherwise. *CLAIM-24 update — Self-Correcting Systems series*

 📊LLM Evaluation  Content type: Code
github.com··DEV

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help