Posted On: Oct 7, 2020
Apache Flink Kinesis Consumer now supports Enhanced Fan Out (EFO) and the HTTP/2 data retrieval API for HAQM Kinesis Data Streams. EFO allows HAQM Kinesis Data Streams consumers to scale by offering each consumer a dedicated read throughput up to 2MB/second. The HTTP/2 data retrieval API reduces latency of data delivery from producers to consumers to 70 milliseconds or better. In combination, these two features allow you to build low latency Apache Flink applications that utilize dedicated throughput from HAQM Kinesis Data Streams.
HAQM Kinesis Data Analytics is the easiest way to transform and analyze streaming data in real time with Apache Flink. Apache Flink is an open source framework and engine for processing data streams. HAQM Kinesis Data Analytics reduces the complexity of building and managing Apache Flink applications. HAQM Kinesis Data Analytics for Apache Flink integrates with HAQM Managed Streaming for Apache Kafka (HAQM MSK), HAQM Kinesis Data Streams, HAQM Elasticsearch Service, HAQM DynamoDB streams, HAQM S3, custom integrations, and more using built-in connectors. You can learn more about HAQM Kinesis Data Analytics for Apache Flink here.
To get started with the Apache Flink Kinesis Data Streams connector with EFO, see the Maven Repository and the GitHub repository for Apache Flink version 1.8.
For a list of where HAQM Kinesis Data Analytics is available, please see the AWS Region Table.