HAQM Managed Service for Apache Flink now supports HAQM DynamoDB Streams as a source

Posted on: Nov 12, 2024

Today, AWS announced support for a new Apache Flink connector for HAQM DynamoDB. The new connector, contributed by AWS for the Apache Flink open source project, adds HAQM DynamoDB Streams as a new source for Apache Flink. You can now process DynamoDB streams events with Apache Flink, a popular framework and engine for processing and analyzing streaming data.

HAQM DynamoDB is a serverless, NoSQL database service that enables you to develop modern applications at any scale. DynamoDB Streams provides a time-ordered sequence of item-level changes (insert, update, and delete) in a DynamoDB table. With HAQM Managed Service for Apache Flink, you can transform and analyze DynamoDB streams data in real time using Apache Flink and integrate applications with other AWS services such as HAQM S3, HAQM OpenSearch, HAQM Managed Streaming for Apache Kafka, and more. Apache Flink connectors are software components that move data into and out of an HAQM Managed Service for Apache Flink application. You can use the new connector to read data from a DynamoDB stream starting with Apache Flink version 1.19. With HAQM Managed Service for Apache Flink there are no servers and clusters to manage, and there is no compute and storage infrastructure to set up.

The Apache Flink repo for AWS connectors can be found here. For detailed documentation and setup instructions, visit our Documentation Page.