Pinned: We’re introducing our eighth generation of TPUs. This time, we’re taking a dual chip approach: TPU 8t, optimized for training, and TPU 8i, optimized for... (opens in new tab)
We’re introducing our eighth generation of TPUs. This time, we’re taking a dual chip approach: TPU 8t, optimized for training, and TPU 8i, optimized for inference. 💪TPU 8t achieves nearly three times the compute performance per pod over our previous generation, Ironwood. ⚡TPU 8i connects 1,152 TPUs in a single pod to deliver the massive throughput and low latency needed to concurrently run millions of agents cost-effectively. These new TPUs are a crucial part of our fully integrated AI stack ...
Read the original article