
Tools
Google and Meta open source TorchTPU, so PyTorch runs natively on TPUs
The open-source release means moving a job off GPUs mostly takes swapping cuda for tpu and nccl for tpu_dist. Eager mode is first class, unlike PyTorch/XLA.
Why it matters: TPUs stop being a JAX only option. Teams with PyTorch code can now price TPU capacity against GPUs without a rewrite, though Google's own speed figures still need outside benchmarks.
