Posted On: Nov 27, 2023
Starting today, the AWS Command Line Interface (AWS CLI) and Python SDK automatically use the AWS Common Runtime (CRT) to accelerate data transfer between HAQM S3 and HAQM EC2 Trn1, P4d, and P5 instances. The AWS CRT implements HAQM S3's performance best practices for request parallelization, automatic retry, DNS load balancing, and more to deliver high data transfer rates between HAQM EC2 and HAQM S3. As a result, machine learning training jobs now download training data from HAQM S3 up to 3x faster and upload model checkpoints to HAQM S3 up to 5x faster, which accelerates total training times.
This change is automatically included in the latest AWS Deep Learning AMIs (DLAMI) when launching HAQM EC2 Trn1, P4d, and P5 instances, which are ideal for generative AI models, including large language and diffusion models. Now, applications that use the AWS CLI and Python SDK to access HAQM S3 automatically get the performance benefits of the AWS CRT. The AWS CRT optimizes for the high network bandwidth available on these instances, so you can get the most out of your compute resources without manually tuning storage performance. To learn more, visit the Python SDK documentation and the CLI documentation.