AWS Big Data Blog
Tag: HAQM Kinesis Data Analyltics
Optimize checkpointing in your HAQM Managed Service for Apache Flink applications with buffer debloating and unaligned checkpoints – Part 2
February 2024: This post was reviewed and updated for accuracy. This post is a continuation of a two-part series. In the first part, we delved into Apache Flink‘s internal mechanisms for checkpointing, in-flight data buffering, and handling backpressure. We covered these concepts in order to understand how buffer debloating and unaligned checkpoints allow us to […]
Optimize checkpointing in your HAQM Managed Service for Apache Flink applications with buffer debloating and unaligned checkpoints – Part 1
This post is the first of a two-part series regarding checkpointing mechanisms and in-flight data buffering. In this first part, we explain some of the fundamental Apache Flink internals and cover the buffer debloating feature. In the second part, we focus on unaligned checkpoints. Apache Flink is an open-source distributed engine for stateful processing over […]
Streaming ETL with Apache Flink and HAQM Kinesis Data Analytics
August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. Most businesses generate data […]