AWS Big Data Blog

Category: HAQM Managed Grafana

Apache Flink + Prometheus

Process millions of observability events with Apache Flink and write directly to Prometheus

In this post, we explain how the new connector works. We also show how you can manage your Prometheus metrics data cardinality by preprocessing raw data with Flink to build real-time observability with HAQM Managed Service for Prometheus and HAQM Managed Grafana.

Correlate telemetry data with HAQM OpenSearch Service and HAQM Managed Grafana

In this post, we show you how to use HAQM OpenSearch Service and HAQM Managed Grafana to correlate the various observability signals that improve root cause analysis, thereby resulting in reduced Mean Time to Resolution (MTTR). We also provide a reference solution that can be used at scale for proactive monitoring of enterprise applications to avoid a problem before they occur.

Enhance monitoring and debugging for AWS Glue jobs using new job observability metrics, Part 2: Real-time monitoring using Grafana

Monitoring data pipelines in real time is critical for catching issues early and minimizing disruptions. AWS Glue has made this more straightforward with the launch of AWS Glue job observability metrics, which provide valuable insights into your data integration pipelines built on AWS Glue. However, you might need to track key performance indicators across multiple […]

Visualize database privileges on HAQM Redshift using Grafana

HAQM Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. HAQM Redshift enables you to use SQL for analyzing structured and semi-structured data with best price performance along with secure access to the data. As more users start querying data in a data warehouse, access control is paramount to protect valuable organizational […]

Enhance operational insights for HAQM MSK using HAQM Managed Service for Prometheus and HAQM Managed Grafana

HAQM Managed Streaming for Apache Kafka (HAQM MSK) is an event streaming platform that you can use to build asynchronous applications by decoupling producers and consumers. Monitoring of different HAQM MSK metrics is critical for efficient operations of production workloads. HAQM MSK gathers Apache Kafka metrics and sends them to HAQM CloudWatch, where you can […]

Build near real-time logistics dashboards using HAQM Redshift and HAQM Managed Grafana for better operational intelligence

HAQM Redshift is a fully managed data warehousing service that is currently helping tens of thousands of customers manage analytics at scale. It continues to lead price-performance benchmarks, and separates compute and storage so each can be scaled independently and you only pay for what you need. It also eliminates data silos by simplifying access […]

Temperature visualization - colorful

Visualize HAQM S3 data using HAQM Athena and HAQM Managed Grafana

Grafana is a popular open-source analytics platform that you can employ to create, explore, and share your data through flexible dashboards. Its use cases include application and IoT device monitoring, and visualization of operational and business data, among others. You can create your dashboard with your own datasets or publicly available datasets related to your […]

Create cross-account, custom HAQM Managed Grafana dashboards for HAQM Redshift

HAQM Managed Grafana recently announced a new data source plugin for HAQM Redshift, enabling you to query, visualize, and alert on your HAQM Redshift data from HAQM Managed Grafana workspaces. With the new HAQM Redshift data source, you can now create dashboards and alerts in your HAQM Managed Grafana workspaces to analyze your structured and […]

Architecture Diagram

Query and visualize HAQM Redshift operational metrics using the HAQM Redshift plugin for Grafana

Grafana is a rich interactive open-source tool by Grafana Labs for visualizing data across one or many data sources. It’s used in a variety of modern monitoring stacks, allowing you to have a common technical base and apply common monitoring practices across different systems. HAQM Managed Grafana is a fully managed, scalable, and secure Grafana-as-a-service […]