Tensor Parallelism

ATP: Adaptive Tensor Parallelism for Foundation Models

Adaptive Tensor Parallelism for efficient foundation model training.

Jan 1, 2023