AWS Storage Blog

Category: Migration & Transfer Services

AWS DataSync Featured Image 2020

Optimizing data transfers for high throughput life science instruments using AWS DataSync

Healthcare and life sciences (HCLS) customers are generating more data than ever as they integrate the use of omics data with applications in drug discovery, clinical development, molecular diagnostics, and population health. The rate and volume of data that HCLS laboratories generate are a reflection of their lab instrumentation and day-to-day lab operations. Efficiently moving […]

Backing up Oracle databases to HAQM S3 at scale

In today’s data-driven world, safeguarding critical information stored in Oracle databases is crucial for enterprises. Companies struggle to efficiently backing up vast amounts of data from hundreds of databases powering enterprise resource planning (ERP) systems and critical applications. These backups must be secure, durable, and easily restorable to ensure business continuity, guard against ransomware, and […]

AWS DataSync Featured Image 2020

Derive insights from AWS DataSync task reports using AWS Glue, HAQM Athena, and HAQM QuickSight

Update (10/30/2024): On October 30, 2024, AWS DataSync launched Enhanced mode tasks, prompting updates to this blog. Updates include a new step in the “Step 2: Populate Glue catalog with task reports data using a Glue crawler” section and detailed information on the new capabilities in “Updated steps for working with task reports of new […]

Migration to HAQM FSx for Windows File Server: cost optimization strategies and automation

Businesses today rely heavily on their file server infrastructure to store, manage, and share mission-critical data. However, maintaining and scaling these environments can be a complex and resource-intensive task. As customer needs and data volumes continue to grow, organizations often face the need to modernize their file server infrastructure. When migrating to HAQM FSx for […]

Direct Supply bolsters availability migrating to HAQM FSx for Windows File Server

Direct Supply, the leading provider of products and services to the Long-Term Care industry, migrated the bulk of our IT systems to AWS in early 2019. In the run-up to our cut over, we had five Server Message Block (SMB) file systems that needed to live alongside the applications they support. This meant that roughly […]

AWS Transfer Family Featured Image

Simplify Active Directory authentication with a custom identity provider for AWS Transfer Family

The secure exchange of files business-to-business is a common and important business practice in highly regulated industries. As organizations grow, maintaining separate user credentials for various platforms, such as file transfer services, can become increasingly complex and time-consuming. As customers build out Managed File Transfer (MFT) environments, often they end up having to create separate, […]

Migrate large HPC datasets from the edge to the cloud then synchronize continuously

Organizations running high-performance computing (HPC) workloads on premises often want to move data to the cloud to leverage scalability, performance, cost optimization, and other benefits of the cloud. For edge locations with limited or no available network bandwidth, online migrations can take a long time or be impossible. In locations where there is limited bandwidth […]

AWS DataSync Featured Image 2020

How London Stock Exchange Group migrated 30 PB of market data using AWS DataSync

London Stock Exchange Group (LSEG) has 30 PB of Tick History-PCAP data, which is ultra-high-quality global market data that is based on raw exchange data, timestamped to the nanosecond. An additional 60 TB is generated every day. LSEG sought to migrate their data from Wasabi cloud storage, LSEG was looking for a new solution to […]

AWS DataSync Featured Image 2020

Transferring data in HAQM S3 between AWS GovCloud (US) Regions and commercial AWS Regions using AWS DataSync

Disclaimer: When transferring data between AWS GovCloud (US) and commercial AWS Regions, it’s crucial to comply with FedRAMP control FRR211. Always consult with your organization’s compliance and security teams to verify that such data transfers align with all applicable federal regulations and policies. AWS users who need to comply with the most stringent US government security […]

AWS DataSync

Transfer customer managed SSE-KMS encrypted objects across AWS accounts and Regions using AWS DataSync

Update (7/12/2024): Post updated to clarify that you must use a fully qualified HAQM Resource Name (ARN) when specifying your customer managed KMS keys. Some organizations have requirements to manage their own data encryption keys, both in general and during data transfer processes. In addition, when considering data transfer solutions (not just for encrypted data), […]