AWS News Blog

Category: Storage

AWS Glue Data Catalog now supports automatic compaction of Apache Iceberg tables

Update November, 16 2023 — I added a link to the documentation with the exact IAM permissions required to use this capability. — Today, we’re making available a new capability of AWS Glue Data Catalog to allow automatic compaction of transactional tables in the Apache Iceberg format. This allows you to keep your transactional data […]

AWS Weekly Roundup

AWS Weekly Roundup – CloudFront security dashboard, EBS snapshots improvements, and more – November 13, 2023

This week, it was really difficult to choose what to recap here because, as we’re getting closer to AWS re:Invent, service teams are delivering new capabilities at an incredible pace. Last week’s launches Here are some of the launches that caught my attention last week: HAQM Aurora – Aurora MySQL zero-ETL integration with HAQM Redshift […]

New – Create application-consistent snapshots using HAQM Data Lifecycle Manager and custom scripts

HAQM Data Lifecycle Manager now supports the use of pre-snapshot and post-snapshot scripts embedded in AWS Systems Manager documents. You can use these scripts to ensure that HAQM Elastic Block Store (HAQM EBS) snapshots created by Data Lifecycle Manager are application-consistent. Scripts can pause and resume I/O operations, flush buffered data to EBS volumes, and […]

HAQM MSK to HAQM S3 architecture diagram

HAQM MSK Introduces Managed Data Delivery from Apache Kafka to Your Data Lake

I’m excited to announce today a new capability of HAQM Managed Streaming for Apache Kafka (HAQM MSK) (HAQM MSK) that allows you to continuously load data from an Apache Kafka cluster to HAQM Simple Storage Service (HAQM S3). We use HAQM Kinesis Data Firehose—an extract, transform, and load (ETL) service—to read data from a Kafka […]

AWS Weekly Roundup

AWS Weekly Roundup: Farewell EC2-Classic, EBS at 15 Years, and More (Sept. 4, 2023)

Last week, there was some great reading about HAQM Elastic Compute Cloud (HAQM EC2) and HAQM Elastic Block Store (HAQM EBS) written by AWS tech leaders. Dr. Werner Vogels wrote Farewell EC2-Classic, it’s been swell, celebrating the 17 years of loyal duty of the original version that started what we now know as cloud computing. […]