MoE

🧩 MoESpecific

mixture of experts, sparse MoE, expert routing, Mixtral, gating network

Feeds to Scour
SubscribedAll
Scoured 75 posts in 43.1 ms

Reversible Foundations: Training a 120B Sparse MoE through State-Preserving Scaling

 🎯Qdrant  Content type: Academic
arxiv.org·

harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.

 🧠LLM Inference  Content type: Code
github.com··Hacker News

NVIDIA Accelerates Google DeepMind’s DiffusionGemma for Local AI

 🤖AI  Content type: Blog
blogs.nvidia.com·

Google’s DiffusionGemma is 4x faster than its other Gemma models

 🤖AI
thenewstack.io·

LLM Inference Handbook 2026

 🤖AI
pub.towardsai.net
·

google/gemma-4-12B-it-qat-q4_0-gguf

 🤖AI
huggingface.co·

DiffusionGemma: 4x Faster Text Generation

 🤖AI  Content type: News  Content type: Blog
blog.google··Hacker News, r/LocalLLaMA, r/singularity

A system programmer’s guide to LLM inference

 🤖AI  Content type: Blog
blog.xiangpeng.systems··Hacker News
Less-relevant results

DiffusionGemma: The Developer Guide- Google Developers Blog

 ⚡Fast AI Inference  Content type: Blog
developers.googleblog.com··r/LocalLLaMA

Nvidia Nemotron 3 Ultra

 🤖AI
research.nvidia.com··Hacker News

MiMo-v2.5-Pro-UltraSpeed: 1T model with 1000 TPS

 ⚡Fast AI Inference  Content type: Blog
mimo.xiaomi.com··Hacker News, r/LocalLLaMA

Achieving Cloud-Grade SLOs for Local Mixture-of-Experts Inference through CPU-GPU Hybrid Design

 🔗High-Speed Networking  Content type: Academic
arxiv.org·

Apple rebuilt its on-device AI stack at WWDC 2026

 ⚡Performance  Content type: Blog
ziraph.com··Hacker News

Running Qwen 35B MoE at 450k Context on a Single 32GB GPU

 🤖AI
local-llm.utop.workers.dev··Hacker News

zhongkaifu/TensorSharp: A C# inference engine for running large language models (LLMs) locally using GGUF model files. TensorSharp provides a console application, a web-based chatbot interface, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/Linux with full GPU capability

 🤖AI  Content type: Code
github.com··Hacker News

Introducing the Third Generation of Apple’s Foundation Models

 🪄Prompt Engineering
machinelearning.apple.com··Hacker News, r/apple

How the UK Is Turning Sovereign AI Ambition Into Action With NVIDIA Technologies

 🔬AI Labs  Content type: Blog
blogs.nvidia.com·

SHAPE: Coalition-Aware Expert Pruning for Sparse Mixture-of-Experts LLMs

 🇨🇳Chinese AI  Content type: Academic
arxiv.org·

Nvidia’s best model is now live

 🆕New AI
thenewstack.io·

The economics of speculative decoding

 🇨🇳Chinese AI  Content type: Blog
fergusfinn.com··Hacker News

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help