⚡ Model Efficiency

Inference Optimization, VRAM Calculation, Performance Tuning, Resource Management

Feeds to Scour
SubscribedAll
Scoured 8671 posts in 96.0 ms
Determining Energy Efficiency Sweet Spots in Production LLM Inference
arxiv.org·1d
⚡LLM Optimization
How I squeezed a BERT sentiment analyzer into 1GB RAM on a $5 VPS
mohammedeabdelaziz.github.io·2h·
Discuss: Hacker News
⚡LLM Optimization
Is Your Machine Learning Pipeline as Efficient as it Could Be?
kdnuggets.com·1d
⚡LLM Optimization
Zero-Latency Local AI: Tuning Your Linux Kernel for LLM Inference 🐧🧠
dev.to·6h·
Discuss: DEV
⚡LLM Optimization
Optimized LLM Inference Engines
rishirajacharya.com·3d
⚡LLM Optimization
Local Agent Bench: Test 11 small LLMs on tool-calling judgment, on CPU, no GPU
github.com·3h·
Discuss: Hacker News, r/LocalLLaMA
⚡LLM Optimization
Understanding LLM Inference Engines: Inside Nano-vLLM (Part 2)
neutree.ai·1d·
Discuss: Hacker News
⚡LLM Optimization
KV-CoRE: Benchmarking Data-Dependent Low-Rank Compressibility of KV-Caches in LLMs
arxiv.org·1d
⚡LLM Optimization
Fast Autoscheduling for Sparse ML Frameworks
ajroot.pl·2d·
Discuss: Hacker News
⚡LLM Optimization
GPU for AI Training: Powering the Next Generation of Intelligent Systems
dev.to·7h·
Discuss: DEV
🔍AI Interpretability
Building Highly Efficient Inference System for Recommenders Using PyTorch
pytorch.org·1d·
Discuss: Hacker News
⚡LLM Optimization
Examining Turbopuffer ANN v3
terencezl.github.io·2d·
Discuss: Hacker News
⚡LLM Optimization
​Sequential Attention: Making AI models leaner and faster without sacrificing accuracy
research.google·3d·
Discuss: Hacker News, r/LocalLLaMA
⚡LLM Optimization
Writing an LLM from scratch, part 32d -- Interventions: adding attention bias
gilesthomas.com·17h·
Discuss: Hacker News
⚡LLM Optimization
Anthropic's Performance Take-Home: A 65x Optimization (For Dummies)
ikot.blog·4d·
Discuss: Hacker News
⚡LLM Optimization
Training language models on TPUs shouldn't be scary
dogac.dev·2d·
Discuss: Hacker News
⚡LLM Optimization
Life at the Edge
asadk.com·5h·
Discuss: Hacker News
⚡LLM Optimization
Continual learning and the post monolith AI era
baseten.co·18h·
Discuss: Hacker News
✍️Prompt Engineering
Mechanistic Interpretability: Peeking Inside an LLM
towardsdatascience.com·2d
⚡LLM Optimization
ML-LIB: Machine Learning Library Proposed For The Linux Kernel
phoronix.com·21h·
Discuss: Hacker News
⚡LLM Optimization

Keyboard Shortcuts

Navigation
Next / previous item
j/k
Open post
oorEnter
Preview post
v
Post Actions
Love post
a
Like post
l
Dislike post
d
Undo reaction
u
Recommendations
Add interest / feed
Enter
Not interested
x
Go to
Home
gh
Interests
gi
Feeds
gf
Likes
gl
History
gy
Changelog
gc
Settings
gs
Browse
gb
Search
/
General
Show this help
?
Submit feedback
!
Close modal / unfocus
Esc

Press ? anytime to show this help