AWS HPC Blog
Tag: AWS Batch
How computer vision is enabling a circular economy
In this post, we show how Reezocar uses computer vision to change the way they detect damage and price used vehicles for re-sale in secondary markets. This reduces landfill and helps achieve the goals of the circular economy.
Automate scheduling of jobs on AWS Batch and AWS Fargate with HAQM EventBridge
In this post we’ll show how to use AWS Batch, AWS Fargate and HAQM Event Bridge to create a job scheduling solution for containers that’s fully managed, serverless, and event-driven.
Improving NFL player health using machine learning with AWS Batch
In this post we’ll show you how the NFL used AWS to scale their ML workloads and produce the first comprehensive dataset of helmet impacts across multiple NFL seasons. They were able to reduce manual labor by 90% and the results beats human labelers in accuracy by 12%!
Diving Deeper into Fair-Share Scheduling in AWS Batch
Today we dive into details of AWS Batch fair share policies and show how they affect job placement. You’ll see the result of different share policies, and hear about practical use cases where you can benefit from fair share job queues in Batch.
How to make digital technologies for the circular economy work for your business
In this post, we discuss the benefits of digital technology for the circular economy, and show how businesses can implement these technologies to get the most out of them for the wellbeing of everyone.
Application deep-dive into the AWS Graviton3E-based HAQM EC2 Hpc7g instance
In this post we’ll show you application performance and scaling results from Hpc7g, a new instance powered by AWS Graviton3E across a wide range of HPC workloads and disciplines.
Accelerating the shift towards a sustainable economy using HPC on AWS
The transition to a sustainable economy is a major goal of many organizations today. HPC plays a pivotal role and in this post we’ll explore how HPC on AWS is enabling the shift towards a sustainable future.
How SeatGeek simulates massive load with AWS Batch to prepare for big events
In this post we explore SeatGeek’s load testing system that simulates 50k simultaneous users. Originally built to prep SeatGeek for large-event traffic spikes, it now runs weekly to help them harden their code.
Streamlining distributed ML workflow orchestration using Covalent with AWS Batch
Complicated multi-step workflows can be challenging to deploy, especially when using a variety of high-compute resources. Covalent is an open-source orchestration tool that streamlines the deployment of distributed workloads on AWS resources. In this post, we outline key concepts in Covalent and develop a machine learning workflow for AWS Batch in just a handful of steps.
Run Celery workers for compute-intensive tasks with AWS Batch
Many applications leverage distributed task systems like Celery to handle asynchronous work. In this post, we describe how to handle compute-intensive Celery tasks using AWS Batch to scale the compute resources and run worker agents.