PipeTransformer: Automated Elastic Pipelining for Distributed Training of Transformers

The dataset used in this paper is ImageNet and SQuAD and GLUE datasets.

Data and Resources

Cite this as

Chaoyang He, Shen Li, Mahdi Soltanolkotabi, Salman Avestimehr (2024). Dataset: PipeTransformer: Automated Elastic Pipelining for Distributed Training of Transformers. https://doi.org/10.57702/az9q7guz

DOI retrieved: December 16, 2024

Additional Info

Field Value
Created December 16, 2024
Last update December 16, 2024
Author Chaoyang He
More Authors
Shen Li
Mahdi Soltanolkotabi
Salman Avestimehr
Homepage https://arxiv.org/abs/2106.09568