AWS Big Data Blog

Category: HAQM Kinesis

Continuous monitoring with Sumo Logic using HAQM Kinesis Data Firehose HTTP endpoints

February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. HAQM Kinesis Data Firehose streams data to AWS destinations such as HAQM Simple Storage Service (HAQM S3), HAQM Redshift, and HAQM OpenSearch Service. Additionally, Kinesis Data Firehose supports destinations to third-party partners. […]

Query your HAQM MSK topics interactively using HAQM Managed Service for Apache Flink Studio

August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. HAQM Managed Service for Apache Flink Studio makes it easy to analyze streaming data in real time and build stream processing applications powered by Apache Flink using […]

How NortonLifelock built a serverless architecture for real-time analysis of their VPN usage metrics

August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. This post presents a reference architecture and optimization strategies for building serverless data analytics solutions on AWS using HAQM Kinesis Data Analytics. In addition, this post shows […]

Register now for Flink Forward Global, October 26-27, 2021

August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. Flink Forward Global 2021 is a 2-day virtual conference for the Apache Flink and stream processing communities. Apache Flink is an open-source distributed engine for processing data […]

HAQM Data Firehose now supports dynamic partitioning to HAQM S3

February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. HAQM Data Firehose provides a convenient way to reliably load streaming data into data lakes, data stores, and analytics services. It can capture, transform, and deliver streaming data to HAQM Simple Storage […]

How MEDHOST’s cardiac risk prediction successfully leveraged AWS analytic services

February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. MEDHOST has been providing products and services to healthcare facilities of all types and sizes for over 35 years. Today, more than 1,000 healthcare facilities are partnering with MEDHOST and enhancing their […]

Secure multi-tenant data ingestion pipelines with HAQM Kinesis Data Streams and Kinesis Data Analytics for Apache Flink

August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. When designing multi-tenant streaming ingestion pipelines, there are myriad ways to design and build your streaming solution, each with its own set of trade-offs. The first decision […]

Auto scaling HAQM Kinesis Data Streams using HAQM CloudWatch and AWS Lambda

This post is co-written with Noah Mundahl, Director of Public Cloud Engineering at United Health Group. Update (12/1/2021): HAQM Kinesis Data Streams On-Demand mode is now the recommended way to natively auto scale your HAQM Kinesis Data Streams. In this post, we cover a solution to add auto scaling to HAQM Kinesis Data Streams. Whether […]

Get started with Flink SQL APIs in HAQM Kinesis Data Analytics Studio

August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. Before the release of HAQM Kinesis Data Analytics Studio, customers relied on HAQM Kinesis Data Analytics for SQL on HAQM Kinesis Data Streams. With the release of […]

Build and optimize real-time stream processing pipeline with HAQM Kinesis Data Analytics for Apache Flink, Part 2

August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. In Part 1 of this series, you learned how to calibrate HAQM Kinesis Data Streams stream and Apache Flink application deployed in HAQM Kinesis Data Analytics for […]