Model Efficiency

⚡ Model Efficiency

Inference Optimization, VRAM Calculation, Performance Tuning, Resource Management

Feeds to Scour
SubscribedAll
Scoured 272 posts in 7.1 ms

Xiaomi MiMo-V2.5-Pro Just Hit 1,000 Tokens Per Second!

 🤖AI
gizchina.com·

Valkey: Unlocked Seattle: The Best Systems Let You Sleep At Night

 ⚡LLM Optimization  Content type: Blog
valkey.io·

libertywing/FlashMemory-Deepseek-V4: FlashMemory DS-V4 Retriever: a lightweight retriever that sparsifies DeepSeek-V4 CSA KV-cache. Weights available on Hugging Face.

 ⚡LLM Optimization  Content type: Code
github.com·

Two Leaps to 1000 Tokens/s on a 1T-Parameter Model: On Inference Systems, Execution Boundaries, and Co-Design

 ⚡LLM Optimization  Content type: Blog
tilert.ai··Hacker News

gist:5b74b8c31e934ff50ce57aa653a343d5

 ⚡LLM Optimization
gist.github.com··r/LocalLLaMA

China's Xiaomi MiMo Is Now 15X Faster Than ChatGPT and Claude (4 minute read)

 🤖AI  Content type: News
decrypt.co··Hacker News

Making LLMs faster and more efficient across multiple languages

 ⚡LLM Optimization
techxplore.com·

WEKA software speeds long context AI inferencing on Oracle’s public cloud

 ⚡LLM Optimization  Content type: News
blocksandfiles.com·

NVIDIA's RTX 5060 May Finally Get The VRAM Upgrade Gamers Wanted

 ⚡LLM Optimization  Content type: News
hothardware.com·

Tech leaker claims that the RTX 50 Super refresh is still on, despite the RAMpocalypse, and it'll be joined by a 12 GB RTX 5060

 💻Tech  Content type: News
pcgamer.com
·

Re: Things that made you go "WTF?" today o_O

 💻Tech
bay12forums.com·

Nvidia GeForce RTX 50 Super GPUs may launch in early 2027 with 50% more VRAM

 ⚡LLM Optimization
club386.com·

VIA-SD: Verification via Intra-Model Routing for Speculative Decoding

 ⚡LLM Optimization  Content type: Academic
arxiv.org·

PowerColor Reaper AMD Radeon RX 9070 16GB - $619.99 - Free shipping for Prime members

 ⚡LLM Optimization
computers.woot.com·

High Bandwidth Flash | A New Memory for AI Data Centers and Edge Computing | Sandisk

 ⚡LLM Optimization
ncnonline.net·

1-bit and 1.58 bit LLM Benchmarking on Jetson Orin Nano Super | Bonsai LM

 🤖AI
smolhub.com··r/LocalLLaMA

DiffusionGemma: 4x Faster Text Generation

 🤖AI  Content type: News  Content type: Blog
blog.google··Hacker News, r/LocalLLaMA, r/singularity

Mid-range GPUs have largely dodged the memory crisis, but not for much longer

 ⚡LLM Optimization
xda-developers.com·

The Death of the Four Golden Signals: Designing Telemetry for Non-Deterministic Infrastructure

 🤖AI
devops.com·

Nvidia is reportedly still planning fabled RTX 50 Super series for 2026, leak claims — lineup could now include a potential 'RTX 5060 Super' with 12GB of VRAM

 ✍️Prompt Engineering  Content type: News
tomshardware.com
·
Sign up or log in to see more results
Sign UpLogin

Keyboard Shortcuts

Navigation

Next / previous item
j/k
Open post
oorEnter
Preview post
v

Post Actions

Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Save / unsave
s

Recommendations

Add interest / feed
Enter
Not interested
x

Go to

Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/

General

Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help