Unified Memory Management
buttondown.com·5h·
Discuss: Hacker News
🧠Memory Allocation Strategies
Hardware recommendations? Mac Mini, NVIDIA Orin, Ryzen AI... ?
reddit.com·7h·
Discuss: r/LocalLLaMA
⚡Hardware Acceleration
Context Kills VRAM: How to Run LLMs on consumer GPUs | by Lyx | May, 2025 | Medium
medium.com·17h
📊Model Serving Economics
LISPy things you can do in 64K bytes of core
t3x.org·10h·
Discuss: Hacker News
🪄Prompt Engineering
Havoc – Heap Allocated Value Object Containers
github.com·11h·
Discuss: Hacker News
🦀Rust
Complexities of Media Streaming
aschey.tech·7h·
Discuss: Lobsters
💾Prompt Caching
LLVM Clang Merges -mcpu=gb10 Support For NVIDIA GB10 Superchip
phoronix.com·11h
⚙️Mechanical Sympathy
Economics of Claude 3 Opus Inference
lesswrong.com·5h
📊Model Serving Economics
A Conversation with Val Bercovici about Disaggregated Prefill / Decode
fabricatedknowledge.com·3h
📊Model Serving Economics
LLDB's TypeSystems Part 2: PDB
walnut356.github.io·8h·
Discuss: r/programming
🦀Rust Compiler Internals
Using a Framework Desktop for local AI
frame.work·4h
🤖AI
Everything From Rookie Mistakes to a New Feature: My Passion Project's Wildest Week
hackernoon.com·1h
🔓Hacking
Core Ultra 7 265K CPU hits all-time low $259 and comes with two free games — 97% of the gaming performance of flagship Core Ultra 9 285K, but costs $260 less
tomshardware.com·14h
🖥️Hardware Architecture
Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
machinelearning.apple.com·23h
🧠LLM Inference
D3D11 Texture Update Costs
eatplayhate.me·10h·
Discuss: Hacker News
⚡Zero-Copy Serialization
Detailed Study of Performance Modeling For LLM Implementations At Scale (imec)
semiengineering.com·3h
🧠LLM Inference
What's //go:nosplit for?
mcyoung.xyz·16h·
Discuss: Hacker News
🧵Async
Build your own SQLite, Part 6: Overflow pages
blog.sylver.dev·31m·
Discuss: Hacker News
💾SQLite
macOS Tahoe extends quantum-secure encryption
eclecticlight.co·17h
🔐Hardware Security
Atomic macOS infostealer adds backdoor for persistent attacks
bleepingcomputer.com·28m·
Discuss: Hacker News
🕳LLM Vulnerabilities