🧠 LLM Inference - emschwartz · Scour

One Refiner to Unlock Them All: Inference-Time Reasoning Elicitation via Reinforcement Query Refinement 🏗️LLM Infrastructure

Scaling Multi-Node Mixture-of-Experts Inference Using Expert Activation Patterns 🧩MoE

Nautile-370M: Spectral Memory Meets Attention in a Small Reasoning Model 🪄Prompt Engineering

When Hidden States Drift: Can KV Caches Rescue Long-Range Speculative Decoding? 🔄Cache Coherence

Large Language Models Decide Early and Explain Later 🏗️LLM Infrastructure

Hardware Generation and Exploration of Lookup Table-Based Accelerators for 1.58-bit LLM Inference ⚡Hardware Acceleration

HGQ-LUT: Fast LUT-Aware Training and Efficient Architectures for DNN Inference 🔢BitNet Inference

The Surprising Universality of LLM Outputs: A Real-Time Verification Primitive 🏗️LLM Infrastructure

CoQuant: Joint Weight-Activation Subspace Projection for Mixed-Precision LLMs 🎯Vector Quantization

Coverage-Based Calibration for Post-Training Quantization via Weighted Set Cover over Outlier Channels 🎯Vector Quantization

Thinking Without Words: Efficient Latent Reasoning with Abstract Chain-of-Thought 🧠Agent Memory

SpikingBrain2.0: Brain-Inspired Foundation Models for Efficient Long-Context and Cross-Platform Inference 🔢BitNet Inference

Log in to enable infinite scrolling