Category: HAQM Managed Streaming for Apache Kafka (HAQM MSK)

In today’s digital age, logging is a critical aspect of application development and management, but efficiently managing logs while complying with data protection regulations can be a significant challenge. Zoom, in collaboration with the AWS Data Lab team, developed an innovative architecture to overcome these challenges and streamline their logging and record deletion processes. In […]

This is a guest blog post co-written with SangSu Park and JaeHong Ahn from SOCAR.  As companies continue to expand their digital footprint, the importance of real-time data processing and analysis cannot be overstated. The ability to quickly measure and draw insights from data is critical in today’s business landscape, where rapid decision-making is key. […]

You can now use HAQM Managed Streaming for Apache Kafka (HAQM MSK) multi-VPC private connectivity (powered by AWS PrivateLink) and cluster policy support for MSK clusters to simplify connectivity of your Kafka clients to your brokers. HAQM MSK is a fully managed service that makes it easy for you to build and run applications that […]

HAQM Managed Streaming for Apache Kafka (HAQM MSK) is a fully managed, highly available, and secure Apache Kafka service. HAQM MSK reduces the work needed to set up, scale, and manage Apache Kafka in production. With HAQM MSK, you can create a cluster in minutes and start sending data. With HAQM MSK Serverless, you can […]

August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. This post was co-written by Mahesh Pasupuleti and Gaurav Shah from Poshmark. Poshmark is a leading social marketplace for new and secondhand styles for women, men, kids, […]

March 2025: This post was reviewed and updated for accuracy. HAQM Managed Streaming for Apache Kafka (HAQM MSK) is an AWS streaming data service that manages Apache Kafka infrastructure and operations, making it easy for developers and DevOps managers to run Apache Kafka applications and Kafka Connect connectors on AWS, without the need to become […]

The value of data is time sensitive. Real-time processing makes data-driven decisions accurate and actionable in seconds or minutes instead of hours or days. Change data capture (CDC) refers to the process of identifying and capturing changes made to data in a database and then delivering those changes in real time to a downstream system. […]

HAQM Managed Streaming for Apache Kafka (HAQM MSK) is an event streaming platform that you can use to build asynchronous applications by decoupling producers and consumers. Monitoring of different HAQM MSK metrics is critical for efficient operations of production workloads. HAQM MSK gathers Apache Kafka metrics and sends them to HAQM CloudWatch, where you can […]

In April 2022, HAQM Managed Streaming for Apache Kafka (HAQM MSK) launched an exciting new capability, HAQM MSK Serverless. HAQM MSK is a fully managed service for Apache Kafka that makes it easier for developers to build and run highly available, secure, and scalable applications based on Apache Kafka. With MSK Serverless, developers can run […]

This post was cowritten with Babu Srinivasan and Robert Walters from MongoDB. HAQM Managed Streaming for Apache Kafka (HAQM MSK) is a fully managed, highly available Apache Kafka service. HAQM MSK makes it easy to ingest and process streaming data in real time and use that data easily within the AWS ecosystem. With HAQM MSK […]