Google Cloud TPU System Architecture: From First Principles to Pod-Scale Training
A deep-dive mental model for TPU system architecture — from single chips to Pod-scale distributed training, covering TPU VM, the MXU systolic array, ICI topology, XLA compilation, SPMD/GSPMD sharding, and the complete path from Python to silicon.