0.5 tok/s with R1 Q4 on EPYC 7C13 with 1TB of RAM, BIOS settings to blame?
i.redd.it·23h·
Discuss: r/LocalLLaMA
🖥️Hardware Architecture
Ayar Labs | Co-packaged Optics Revolution | The Most Promising Hardware Startup With Wins At HPE And Nvidia?
semianalysis.com·21h·
Discuss: Hacker News
🖥GPUs
In which I write a library-quality B+ tree with the genies
tidyfirst.substack.com·4h·
Discuss: Substack
🦀Rust Compiler Internals
Getting an LLM to set its own temperature
amanvir.com·20h·
Discuss: Hacker News
🕳LLM Vulnerabilities
Introducing Active CPU pricing for Fluid compute
vercel.com·6h
🖥GPUs
How hippocampal place cells and synaptic plasticity contribute to the progressive acquisition of memories
medicalxpress.com·8h
🔬Chip Fabrication
How to Streamline Complex LLM Workflows Using NVIDIA NeMo-Skills
developer.nvidia.com·19h
🏆LLM Benchmarking
‘M3GAN 2.0’ Review: The Demon-Doll Android Is Now the Heroine of a ‘Cautionary’ Sci-Fi Action Thriller That’s Bigger, Longer and Less Fun - Variety
news.google.com·3h
🆕New AI
Building for the World That Doesn’t Blink
hackernoon.com·19h
💾Persistence Strategies
Slashing CI Costs at Uber
uber.com·9h·
Discuss: Hacker News
🛠️Build Optimization
Attention Isn’t All You Need. This Is.
pub.towardsai.net·2h
🪄Prompt Engineering
🎲 Configuring Orgzly Interaction with Directory Local Variables
arnesonium.com·13h
💫IO_uring
AsmJit: Lightweight C++ library for low-latency machine code generation
asmjit.com·18h·
Discuss: Hacker News
⚙️Language Runtimes
Planning to make a new micro blogging platform :)
wittywritr.bearblog.dev·4h
🏠Small tech services
Toward Environmentally Equitable AI
cacm.acm.org·4h
🖥GPUs
PDP-11 Replica: The PiDP-11
obsolescence.dev·6h·
Discuss: Hacker News
📟Terminals
How we scored #1 on Terminal Bench (52%)
warp.dev·19h
📟Terminals
AVX-512's Enormous Advantage On AMD EPYC 4005 Series Performance
phoronix.com·4h
🖥️Hardware Architecture
Join me if you can: ClickHouse vs. Databricks & Snowflake - Part 2
clickhouse.com·19h·
Discuss: Hacker News
⚙️Database Internals
VMware Cloud Foundation (VCF) on Minisforum MS-A2
williamlam.com·3h
🏠Self-hosting