Google releases open-source TPU Sync for KV cache transfers
Google Cloud has released TPU Sync, an Apache-2.0 C++ library for moving KV caches and model weights across Cloud TPU memory tiers. It treats TPU HBM, pinned host DRAM, shared storage and the data-center network as a single hierarchy, using asynchronous DMA while preserving the tensors’ TPU tile layout. Python wheels are available for PyTorch and JAX.