Posted On: Dec 26, 2023
With zero buffering, customers can deliver data to HAQM S3, HAQM OpenSearch Service, HAQM Redshift, and third-party HTTP destinations within seconds enabling real time use cases.
Currently, HAQM Kinesis Data Firehose buffers data for at least sixty seconds before delivering it to a destination. However, many customers want faster insights from their data. With zero buffering, customers can setup a HAQM Kinesis Data Firehose stream to not buffer data before delivery, and most streams with no additional processing are delivered within five seconds. To meet lower latency use cases, zero buffering is also supported for Lambda that is used by customers for data transformation within HAQM Kinesis Data Firehose. For some use cases where zero buffering is not suitable, customers have the flexibility to choose a lower buffering interval anywhere from zero to maximum buffering interval range.
For third party destinations, before you make the change, please check with the vendor for recommended buffering settings of Kinesis Data Firehose.
HAQM Kinesis Data Firehose is the easiest way to load streaming data into AWS. To get started with Kinesis Data Firehose, visit the console and the developer guide. To learn more about zero buffering, refer to the documentation.