Generation at the Speed of Thought: Speculative Decoding
🔵LLM frameworks and AI libraries for TypeScript
Flag this post
TIL: For long-lived LLM sessions, swapping KV Cache to RAM is ~10x faster than recalculating it. Why isn't this a standard feature?
🦙Simple finetuning LLMs
Flag this post
Cure - Verification-First Programming for the BEAM
🔵LLM frameworks and AI libraries for TypeScript
Flag this post
A tiny and simple Open Source library to call LLM APIs with in-built rate-limiting, retries, circuit breaker...
🔵LLM frameworks and AI libraries for TypeScript
Flag this post
Cons Should Not Cons Its Arguments, Part II: Cheney on the MTA
🦀Rust language vector embeddings
Flag this post
Cycle-accurate 6502 emulator as coroutine in Rust
🔥Svelte
Flag this post
Opportunistically Parallel Lambda Calculus
🔵LLM frameworks and AI libraries for TypeScript
Flag this post
Nimony v0.2 – early preview of Nim 3.0's compiler
🔵LLM frameworks and AI libraries for TypeScript
Flag this post
Incremental Compilation in Recursive‑Descent Parser (Roslyn)
🦀Rust language vector embeddings
Flag this post
ZkML Breakthrough: 13B Models Verified in 15 Minutes
🔄AI Pipeline design and techniques
Flag this post
Monster Splash double-hires demo for Apple IIe
🧩WASI
Flag this post
No Cap, This Memory Slaps: Breaking Through the OLTP Memory Wall
🦙Simple finetuning LLMs
Flag this post
Loading...Loading more...