PGDS approach to full model inference on consumer grade GPUs
reddit.com·15h·
Discuss: r/LocalLLaMA
📊Model Serving Economics
Detailed Study of Performance Modeling For LLM Implementations At Scale (imec)
semiengineering.com·3h
🏆LLM Benchmarking
Context Kills VRAM: How to Run LLMs on consumer GPUs | by Lyx | May, 2025 | Medium
medium.com·17h
📊Model Serving Economics
Economics of Claude 3 Inference
lesswrong.com·5h
📊Model Serving Economics
Researchers Found a Better Way to Teach Large Language Models New Skills
news.ncsu.edu·5h·
Discuss: Hacker News
🏆LLM Benchmarking
A Conversation with Val Bercovici about Disaggregated Prefill / Decode
fabricatedknowledge.com·3h
📊Model Serving Economics
Using a Framework Desktop for local AI
frame.work·4h
🤖AI
Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
machinelearning.apple.com·23h
🏆LLM Benchmarking
AI cloud infrastructure gets faster and greener: NPU core improves inference performance by over 60%
techxplore.com·2h
📊Model Serving Economics
The Era of Exploration
yidingjiang.github.io·8h·
Discuss: Hacker News
🏆LLM Benchmarking
Looking for the Number 4 Inside the Black Box
determinedquokka.bearblog.dev·19h
🔍AI Interpretability
Understanding PPO for LLMs
stpn.bearblog.dev·19h
🏆LLM Benchmarking
Re-implementing LangChain in 100 lines of code (2023)
blog.scottlogic.com·4h·
Discuss: Lobsters
🪄Prompt Engineering
Function over Form: Why Dynamic Sparsity Is the Only Path to AGI
dmf-archive.github.io·16h·
Discuss: Hacker News
⚡Hardware Acceleration
Fused Qwen3 MoE layer for faster training Qwen3-30B-A3B LoRA
github.com·23h·
Discuss: r/LocalLLaMA
🤖AI
Approach improves how new skills are taught to large language models
techxplore.com·10h
🏆LLM Benchmarking
Radial Attention: O(nlogn) Attention for Long Video Generation with 2-4× Speedup
hanlab.mit.edu·3h·
Discuss: Hacker News
⭐Content Scoring
Don’t Build Chatbots — Build Agents With Jobs
thenewstack.io·8h
🏆LLM Benchmarking
Using a Framework Desktop for local AI
frame.work·4h
🤖AI
Weight‑Generative Tuning for Multi‑Faceted Efficient Adaptation of Large Models
icml.cc·3h·
Discuss: Hacker News
📱Edge AI Optimization