⚡ Inference Optimization - SeanNg · Scour

How low-bit inference enables efficient AI

dropbox.tech·17h·

Discuss: Hacker News

🎯Fine-tuning

PACE: Prefix-Protected and Difficulty-Aware Compression for Efficient Reasoning

arxiv.org·1d

🪟Context Windows

LLM Optimization: From Research to Production

dev.to·13h·

Discuss: DEV

🎯Fine-tuning

Selective Prior Synchronization via SYNC Loss

arxiv.org·1d

🪟Context Windows

Token Pruning and Prompt Compression in Modern AI

dev.to·6h·

Discuss: DEV

🔤Tokenization

Two different tricks for fast LLM inference

seangoedecke.com·4h·

Discuss: Hacker News

The batch size in training

breno.bearblog.dev·13h

🎯Fine-tuning

Deterministic Inference with EigenAI

deterministicinference.com·3d

AI Inference Needs A Mix-And-Match Memory Strategy

semiengineering.com·2d

🪟Context Windows

chrisarg/Bit: A Bit vector library for learning fun and also work

github.com·12h

Symbolic analysis of Grover search algorithm via Chain-of-Thought reasoning and quantum-native tokenization

nature.com·10m

🎭Anthropic Claude

EyesOff: Why Some Models Quantize Better Than Others

ym2132.github.io·3d·

Discuss: Hacker News

🎯Fine-tuning

Completed Hyperparameter Transfer across Modules, Width, Depth, Batch and Duration

machinelearning.apple.com·2d

🎯Fine-tuning

Workflow Utility Spotlight: Fast Impulse Response Handling for Spatial Audio

hackernoon.com·3h

Building a Smarter Image Search with Gemini and Elasticsearch

pub.towardsai.net·10h

🎲 Fine-Tuning an AI

zwischenzugs.com·13h

Causal Inference through the lens of probabilistic programming

2026.pycon.de·1d

An improved soft sensing method for measuring the liquid amount inside cylinders of ionic compressors based on pressure reconstruction

sciencedirect.com·1d

👁️Computer Vision

DeepSeek-V3.2 on GB300: Performance Breakthrough

blog.vllm.ai·2d

Stitching Vision Encoders into LLMs: Clip vs. I-JEPA vs. ViT Comparison

teendifferent.substack.com·2h·

Discuss: Substack

🎯Fine-tuning

Loading more...