AWS Storage Blog
Category: Learning Levels
Getting visibility into storage usage in multi-tenant HAQM S3 buckets
SaaS providers with multi-tenant environments use cloud solutions to dynamically scale their workloads as customer demand increases. As their cloud footprint grows, having visibility into each end-customer’s storage consumption becomes important to distribute resources accordingly. An organization can use storage usage data per customer (tenant) to adjust its pricing model or better plan its budget. […]
Consolidate and query HAQM S3 Inventory reports for Region-wide object-level visibility
Organizations around the world store billions of objects and files representing terabytes to petabytes of data. Data is often owned by different teams, departments, or business units, spanning multiple locations. As the amount of datastores, locations, and owners grow, you need a way to cost-effectively maintain visibility on important characteristics of your data, including based […]
Migrate compute from Google Cloud Platform (GCP) to AWS using AWS Application Migration Service
Customers using Google Cloud Platform (GCP) might explore the option of spreading or transitioning their cloud usage away from GCP to alternative providers for various reasons, including cost evaluations, data centralization, or changes in business requirements. Regardless of the motivating factors, adopting effective migration solutions can lead to time and cost savings while reducing downtime. […]
Cross-region disaster recovery with HAQM FSx for NetApp ONTAP
Data protection is a top priority for our customers. Your disaster recovery (DR) strategy might require you to continuously replicate your data across multiple geographic regions to mitigate against natural disasters such as earthquakes or technical disasters that may affect a particular geographic region. HAQM FSx for NetApp ONTAP, which provides fully managed shared storage […]
Identify cold objects for archiving to HAQM S3 Glacier storage classes
Update (02/13/2024): Consider HAQM S3 Lifecycle transition fees that are charged based on the total number of objects being transitioned, the destination storage class (listed on the HAQM S3 pricing page), as well as the additional metadata charges applied. You can use the S3 pricing calculator to estimate the total upfront and monthly costs by […]
How Orca Security efficiently shares encrypted HAQM EBS Snapshots
Orca Security, an AWS Partner, is an independent cybersecurity software provider whose agent-less cloud security environment is trusted by hundreds of enterprises globally. Orca makes cloud security simple for enterprises moving to and scaling with AWS with its patented SideScanning™ technology and Unified Data Model. Orca’s customers use HAQM Elastic Block Store (HAQM EBS) volumes […]
Derive insights from AWS DataSync task reports using AWS Glue, HAQM Athena, and HAQM QuickSight
Update (9/22/2023): Step 6b updated to automatically detect and update the HAQM Athena table schema when crawler detects large data transfer values reported in bytes that would consume the table’s maximum integer value while storing data. As customers scale their migration of large datasets with millions of files across multiple data transfers, they are faced […]
How Continental uses Mountpoint for HAQM S3 in autonomous driving development – accelerating simulation performance by 20%
Continental and AWS have been collaborating to create the Continental Automotive Edge (CAEdge) framework – a modular hardware and software environment that connects the vehicle to the cloud and features virtual workbenches. The platform includes a virtual workbench offering numerous options to develop, supply, and maintain software-intensive system functions. It supports a wide range of automotive […]
HAQM Elastic Block Store at 15 Years
Just after joining HAQM Web Services in 2009, I met with Andrew Certain, at that time a senior engineer on the HAQM Elastic Block Store (HAQM EBS) team, to get into the details on how EBS was implemented and what plans were looking forward. Andrew took me through the details of this remote block storage […]
Optimizing performance of Apache Spark workloads on HAQM S3
This blog covers performance metrics, optimizations, and configuration tuning specific to OSS Spark running on HAQM EKS. For customers using or considering HAQM EMR on EKS, refer to the service documentation to get started and this blog post for the latest performance benchmark. Performance is top of mind for customers running streaming, extract transform load […]