📊 Model Serving Economics - emschwartz · Scour

Characterizing Software Aging in GPU-Based LLM Serving Systems

🏗️LLM Infrastructure Academic

harshuljain13/llm-inference-at-scale: A Practitioner handbook for production llm serving.

🧠LLM Inference Code

github.com··Hacker News, r/LLM

NetX-lab/Frontier: Frontier: A Discrete-Event Simulator for Modern LLM Serving

🏗️LLM Infrastructure Code

github.com··Hacker News

BUDDY: BUdget-Driven DYnamic Depth Routing for Adaptive Large Language Model Inference

🤖AI Academic

SPEAR: A System for Post-Quantization Error-Adaptive Recovery Enabling Efficient Low-Bit LLM Serving

🔬RaBitQ Academic

Beyond Per-Token Pricing: A Concurrency-Aware Methodology for LLM Infrastructure Cost Estimation

🏗️LLM Infrastructure Academic

Less-relevant results

TabSwift: An Efficient Tabular Foundation Model with Row-Wise Attention

🦀New Rust Features Academic

ReSET: Accurate Latency-Critical NVFP4 Reasoning via Step-Aware Temperature Scaling

⚡Fast AI Inference Academic

Heterophily-Aware Adaptive Knowledge Distillation for Hypergraph Neural Networks

📱Edge AI Optimization Academic

AVIS: Adaptive Test-Time Scaling for Vision-Language Models

🪄Prompt Engineering Academic

VIA-SD: Verification via Intra-Model Routing for Speculative Decoding

📐TLA+ Academic

Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination

⚡Fast AI Inference Academic

FlowBank: Query-Adaptive Agentic Workflows Optimization through Precompute-and-Reuse

🔄Incremental Computation Academic

Beyond Raw Signals: Undecoded Generative Latents as Privileged Synthetic Data

✨Gemini Academic

Teaching Diffusion to Speculate Left-to-Right

⚡Fast AI Inference Academic

Organize then Retrieve: Hierarchical Memory Navigation for Efficient Agents

🧠Agent Memory Academic

Distilling LLM Reasoning into an Interpretable Policy Tree for Human-AI Collaboration

🏗️LLM Infrastructure Academic

FAME: Forecastability-Aware Mixture of Experts for Heterogeneous Time Series Forecasting

🧩MoE Academic

Stop Early, Spend Less: Hidden-State Probes as a Practical Recipe for Streaming Moderation of LLM Outputs

🧠LLM Inference Academic

Less Context, Better Agents: Efficient Context Engineering for Long-Horizon Tool-Using LLM Agents

🎭Claude Academic

No more posts from emschwartz's subscribed feeds.

Scour all 25264 feeds Learn more about Feeds

Log in to enable infinite scrolling