Posted On: Nov 18, 2020
You can now use Cruise Control to more easily scale and balance I/O in your HAQM Managed Streaming for Apache Kafka (HAQM MSK) clusters. Cruise Control is a popular tool among Apache Kafka users because it drastically simplifies partition management. Cruise Control can also be used to monitor the state and health of clusters using an optional user interface dashboard.
Cruise Control integrates with HAQM MSK’s open monitoring for Prometheus feature and is also compatible with any Apache Kafka cluster that uses Prometheus for metric aggregation. HAQM MSK contributed to Cruise Control to make this integration possible, and was supported by other contributors to the open source project.
HAQM MSK offers free virtual workshops where customers can learn how to build solutions, including setting up an end-to-end clickstream analytics pipeline, and how to use MirrorMaker 2.0 for migration or replication. We’ve also added a new lab that shows you how to setup and use Cruise Control with HAQM MSK. Visit the HAQM MSK Cruise Control workshop to get started. You can also visit the HAQM MSK Documentation or the Cruise Control project page for more information.
HAQM MSK is a fully managed service for Apache Kafka that makes it easy for you to build and run applications that use Apache Kafka as a data store. HAQM MSK is 100% compatible with Apache Kafka, which enables you to quickly migrate your existing Apache Kafka workloads to HAQM MSK with confidence or build new ones from scratch. With HAQM MSK, you spend more time innovating on applications and less time managing clusters. To learn how to get started, see the HAQM MSK Developer Guide.