🎛️ Tokio Internals - emschwartz · Scour

Yori – Isolating AI Logic into "Semantic Containers" (Docker for Code)

news.ycombinator.com·3h·

Discuss: Hacker News

harishsg993010/tiny-NPU: opensource NPU for LLM inference (this run gpt2)

github.com·12h·

Discuss: r/LocalLLaMA

🏗️LLM Infrastructure

Breaking the Tractability Barrier: A Generic Low-Level Solver for NP-Hard Instances (N=63) on Commodity 64-Bit Silicon

zenodo.org·1h·

Discuss: r/programming

🧮SMT Solvers

Optimal timing for superintelligence

marginalrevolution.com·7h

🚀Async Optimization

ktop: Python-based terminal system resource monitor for hybrid LLM workloads

github.com·1d

⚡Systems Performance

Real-Time AI Streaming in Production: What We Built at Helpmaton

metaduck.com·16h

🧠Inference Serving

ianbarber.blog·1d·

Discuss: Hacker News

🔮Prefetching

LHAW: Controllable Underspecification for Long-Horizon Tasks

arxiv.org·1d

rust.libhunt.com·10h

PromptもFine-tuningも不要なLLM出力言語の制御手法｜はち

note.com·21h

🔤Tokenization

Scheduling in a changing world: Maximizing throughput with time-varying capacity

research.google·1d

📅Resource Scheduling

Functional Optics for Modern Java

blog.scottlogic.com·1d

🌊Async Patterns

MiniMax M2.5 in Cline: Built for a World Where Agents Work Together

cline.ghost.io·12h

models have some pretty funny attractor states

lesswrong.com·10h

An async HTTP server in ~80 lines of modern C++ (coroutines)

vixcpp.com·1d·

Discuss: Hacker News

Concurrent vs. Parallel Execution in LLM API Calls: From an AI Engineer’s Perspective

pub.towardsai.net·4d

🚀Async Optimization

Neon Compute Autoscaling Report

neon.com·11h

Supercharging Inference for AI Factories: KV Cache Offload as a Memory-Hierarchy Problem

blog.min.io·16h

🏗️LLM Infrastructure

remote locks and distributed locks

tautik.me·1d

🔓Lock-Free Structures

A high-performance Go framework (250k+ req/sec) with built-in batteries

go-kvolt.github.io·2d

Loading more...