Google releases TPU Sync to speed up AI model serving
Google Cloud has open-sourced TPU Sync, a library that moves AI model memory between chips, host RAM and storage. In Google's own tests, it cut transfer times by over 90% for large models. Google says it is not yet recommended for general use.
Where this came from. One outlet reported this. We read it, then wrote the sixty words above.