Posted On: Nov 21, 2023
Today, we are excited to announce that Apache Flink is now generally available for HAQM EMR on EKS. With Apache Flink for HAQM EMR on EKS, customers can transform and analyze streaming data in real time with Apache Flink, an open-source framework for stateful computations over data streams. HAQM EMR on EKS is a deployment option for HAQM EMR that makes it easy for customers to run their big data applications and data lake analytics workloads on EKS. Customers already using HAQM EKS can run their Apache Flink application along with other types of applications on the same HAQM EKS cluster, helping improve resource utilization and simplify infrastructure management.
With this launch, customers can use Apache Flink on HAQM EMR on EKS to reduce the complexity of building and configuring Apache Flink applications. Customers can also leverage spot instance in Flink application with graceful decommission, and can achieve faster restart time using fine grained recovery and task local recovery with EBS. In addition, customers get access to key accessibility and monitoring features such as launching Flink application using jars in HAQM S3, monitoring integration with HAQM S3 and HAQM CloudWatch and container log rotation. Finally, customer can use connectors to integrate HAQM EMR on EKS with HAQM Glue Data Catalog, HAQM Kinesis Data Streams, HAQM DynamoDB Streams, and more.
To learn more and get started, please visit our Apache Flink section documentation. Apache Flink for EMR on EKS is available with EMR release 6.15 and in all the regions where HAQM EMR on EKS is currently available.