AWS Big Data Blog

Category: Management Tools

Visualize and Monitor HAQM EC2 Events with HAQM CloudWatch Events and HAQM Kinesis Firehose

September 8, 2021: HAQM Elasticsearch Service has been renamed to HAQM OpenSearch Service. See details. Monitoring your AWS environment is important for security, performance, and cost control purposes. For example, by monitoring and analyzing API calls made to your HAQM EC2 instances, you can trace security incidents and gain insights into administrative behaviors and access […]

Analyze Security, Compliance, and Operational Activity Using AWS CloudTrail and HAQM Athena

As organizations move their workloads to the cloud, audit logs provide a wealth of information on the operations, governance, and security of assets and resources. As the complexity of the workloads increases, so does the volume of audit logs being generated. It becomes increasingly difficult for organizations to analyze and understand what is happening in […]

Respond to State Changes on HAQM EMR Clusters with HAQM CloudWatch Events

Jonathan Fritz is a Senior Product Manager for HAQM EMR Customers can take advantage of the HAQM EMR API to create and terminate EMR clusters, scale clusters using Auto Scaling or manual resizing, and submit and run Apache Spark, Apache Hive, or Apache Pig workloads. These decisions are often triggered from cluster state-related information. Previously, […]

Analyze a Time Series in Real Time with AWS Lambda, HAQM Kinesis and HAQM DynamoDB Streams

This is a guest post by Richard Freeman, Ph.D., a solutions architect and data scientist at JustGiving. JustGiving in their own words: “We are one of the world’s largest social platforms for giving that’s helped 26.1 million registered users in 196 countries raise $3.8 billion for over 27,000 good causes.” Introduction As more devices, sensors […]