Partitioning
Splitting one dataset across many nodes — key ranges, hashing, and the skew that neither of them fully solves.
31 posts
Splitting one dataset across many nodes — key ranges, hashing, and the skew that neither of them fully solves.
Deploying an LLM for many tenants on a single TPU machine — one HBM pool, one scheduler, and no horizontal escape hatch.
How databases stay in sync across multiple nodes — leader/follower, multi-leader, and leaderless replication.
What a TPU actually is and how the whole stack fits together, from a single chip to Pod-scale distributed training.