This is a pre-built Java application that offers an easy way to collect and send data to your HAQM Kinesis data stream. You can install the agent on Linux-based server environments such as web servers, log servers, and database servers. The agent monitors certain files and continuously sends data to your data stream. Get HAQM Kinesis Agent.
This is a pre-built library that helps you easily build HAQM Kinesis Applications for reading and processing data from an HAQM Kinesis stream. This library handles complex issues such as adapting to changes in stream volume, load-balancing streaming data, coordinating distributed services, and processing data with fault-tolerance, enabling you to focus on business logic while building applications. Get Kinesis Client Library for Java | Python | Ruby | Node.js | .NET
Use AWS Streaming Data Solution for HAQM Kinesis to help you solve for real-time streaming use cases like capturing high volume application logs, analyzing clickstream data, continuously delivering to a data lake, and more.
This solution shortens your development time by days by removing or reducing the need for you to: model and provision resources using AWS CloudFormation; set up HAQM CloudWatch alarms, dashboards, and logging; and manually implement streaming data best practices in AWS. This solution is data and logic agnostic, enabling you to start with boilerplate code and quickly start customizing. After deployment, you can use the solution’s monitoring capabilities to easily transition to production.
This is an easy to use and highly configurable library that helps you put data into an HAQM Kinesis stream. This library presents a simple, asynchronous, and reliable interface that enables you to quickly achieve high producer throughput with minimal client resources. Get Kinesis Producer Library.
This is a pre-built library that helps you easily integrate HAQM Kinesis Data Streams with other AWS services and third-party tools. HAQM Kinesis Client Library (KCL) is required for using this library. The current version of this library provides connectors to HAQM DynamoDB, HAQM Redshift, HAQM S3, and Elasticsearch. The library also includes sample connectors of each type, plus Apache Ant build files for running the samples. Get Kinesis Connector Library.
This is a pre-built library that helps you easily integrate HAQM Kinesis Data Streams with Apache Storm. The current version of this library fetches data from HAQM Kinesis stream and emits it as tuples. You will add the spout to your Storm topology to leverage HAQM Kinesis Data Streams as a reliable, scalable, stream capture, storage, and replay service. Get Kinesis Storm Spout.
Learn how to build a real-time sliding-window dashboard with HAQM Kinesis Data Streams and Apache Storm.
Enables HAQM Elastic MapReduce (EMR) to directly read and query data from HAQM Kinesis data streams.
Learn more | Frequently Asked Questions for EMR Connector to Kinesis
HAQM Kinesis Recorder enables you to reliably record data to an HAQM Kinesis data stream from your mobile application.
An implementation of the Apache Log4J Appender Interface that pushes Log4J output directly to HAQM Kinesis data streams without requiring any custom code.
A plugin that allows Fluentd to add data to HAQM Kinesis data streams.
HAQM Kinesis Source and Sink for Apache Flume service.
An HAQM Kinesis Data Streams receiver that creates an input DStream using the HAQM Kinesis Client Library.
Enables developers to write record processors in Go language using HAQM Kinesis Client Library multi-language daemon.
Enables the automatic creation and visualization of aggregated time series data from HAQM Kinesis data streams.
Enables scaling the number of shards of an HAQM Kinesis data stream. Developers can scale up or down by specifying a certain number of shards or a percentage of the total number of shards.
Enables receiving events published by other Vert.x verticles and sending those events to HAQM Kinesis Data Streams.