AWS Storage Blog

Tag: HAQM S3 Inventory

HAQM S3 featured image 2023

Cost-optimized log aggregation and archival in HAQM S3 using s3tar

According to a study by the International Data Corporation (IDC), the global datasphere is expected to grow from 33 zettabytes (ZB) in 2018 to 175 ZB by 2025, a staggering five-fold increase. Organizations that leverage distributed architectures generate a significant portion of their data footprint from observability data, including application logs, metrics, and traces, which […]

HAQM S3 Object Lambda

Access a point in time with HAQM S3 Object Lambda

Point-in-time ‘snapshots’ enable administrators, developers, testers, and end users to quickly access a storage volume or share how it was at an earlier point-in-time. They are a longstanding approach to data protection and recovery, tracking changes within a storage system to reduce both Recovery Point Objective (RTO) and Recovery Time Objective (RTO). However, traditional snapshots […]

HAQM S3 Object Lock

Maintaining object immutability by automatically extending HAQM S3 Object Lock retention periods

Protecting against accidental or malicious deletion is a key element of data protection. Immutability protects data in-place, preventing unintended changes or deletions. However, sometimes it isn’t clear for how long data should be made immutable. Users in this situation are looking for a solution that maintains short-term immutability, indefinitely. They want to make sure their […]

HAQM S3 featured image 2023

Managing duplicate objects in HAQM S3

When managing a large volume of data in a storage system, it is common for data duplication to happen. Data duplication in data management refers to the presence of multiple copies of the same data within your system, leading to additional storage usage as well as extra overhead when handling multiple copies of the same […]

HAQM S3 Archive Storage Classes

Simplify querying your archive data in HAQM S3 with HAQM Athena

Today, customers increasingly choose to store data for longer because they recognize its future value potential. Storing data longer, coupled with exponential data growth, has led to customers placing a greater emphasis on storage cost optimization and using cost-effective storage classes. However, a modern data archiving strategy not only calls for optimizing storage costs, but […]

HAQM S3 featured image - new

Getting visibility into storage usage in multi-tenant HAQM S3 buckets

SaaS providers with multi-tenant environments use cloud solutions to dynamically scale their workloads as customer demand increases. As their cloud footprint grows, having visibility into each end-customer’s storage consumption becomes important to distribute resources accordingly. An organization can use storage usage data per customer (tenant) to adjust its pricing model or better plan its budget. […]

HAQM S3 featured image - new

Consolidate and query HAQM S3 Inventory reports for Region-wide object-level visibility

Organizations around the world store billions of objects and files representing terabytes to petabytes of data. Data is often owned by different teams, departments, or business units, spanning multiple locations. As the amount of datastores, locations, and owners grow, you need a way to cost-effectively maintain visibility on important characteristics of your data, including based […]

HAQM S3 featured image - new

Disabling HAQM S3 access control lists with S3 Inventory

Access control lists (ACLs) define user access and the operations users can take on specific resources. HAQM Simple Storage Service (HAQM S3) was launched in 2006 with ACLs as its first authorization mechanism. Since 2011, HAQM S3 has also supported AWS Identity and Access Management (IAM) policies for managing access to S3 buckets, and it recommends […]

Restoring archived objects at scale from the HAQM S3 Glacier storage classes

Update (7/26/2024): You no longer need to optimize the S3 Inventory report using HAQM Athena. HAQM S3 will automatically optimize your S3 Batch Operations restore job to achieve the fastest retrieval throughput. For more guidance on using batch operations, learn more in the S3 User Guide. Every organization around the world has archival data. There is […]

HAQM S3 Glacier Instant Retrieval

How Photobox optimizes storage costs for over 12 billion photos with HAQM S3 Glacier Instant Retrieval

albelli-Photobox Group is a leading player in the online European photo product and gifting market. We serve a pan-European customer base of over 7 million customers. At Photobox, we are focused on inspiring our customers to easily make beautiful photo products and bring their special moments to life. Whether it’s a birthday, holiday, or any […]