AWS HPC Blog

Tag: model inference

Scalable and Cost-Effective Batch Processing for ML workloads with AWS Batch and HAQM FSx

Batch processing is a common need across varied machine learning use cases such as video production, financial modeling, drug discovery, or genomic research. The elasticity of the cloud provides efficient ways to scale and simplify batch processing workloads while cutting costs. In this post, you’ll learn a scalable and cost-effective approach to configure AWS Batch Array jobs to process datasets that are stored on HAQM S3 and presented to compute instances with HAQM FSx for Lustre.