“Running Local Models Is Good Now” Was Written on a 64GB Mac. Half of You Have 16GB or Less (opens in new tab)

52% of PCs have 16GB RAM or less. Here’s what local LLMs actually fit, what the KV cache costs you, and why Mac and PC 16GB are not equal.