What AI Inference Actually Demands From a NAND SSD (opens in new tab)

KV cache storage is a distinct workload that requires SSDs designed for it. Number of cell levels, block sizes, and data placements all matter, and some SSD flash makers are actually getting it right.