AWS Storage Blog
Tag: HAQM Simple Storage Service (HAQM S3)
Automate HAQM S3 File Gateway deployments in VMware with Terraform by HashiCorp
Many customers have adopted an Infrastructure as Code (IaC) process within their organization to streamline and optimize provisioning infrastructure. Without an IaC practice in place, it becomes increasingly difficult to manage the scale of today’s infrastructure. IaC can help your organization manage IT infrastructure needs while also improving consistency and reducing errors and manual configuration. […]
Private cross-Region disaster recovery with AWS Elastic Disaster Recovery
Editor’s note: Before reading about cross-Region disaster recovery using private connectivity in this blog, learn how to install an AWS DRS agent in a secured network in this blog. Update 5/7/2024: Steps for creating a security group that allows port 443 from the source VPC added to section “2. Establish private connectivity” and steps for […]
Authenticating to AWS Transfer Family with Azure Active Directory and AWS Lambda
Note (5/11/2023): The sample solution provided in this blog post does not support Multi-Factor Authentication (MFA) with Azure Active Directory. Managing users at scale across multiple systems can become a time-intensive process, adding undue burden to system administrators. User management is increasingly complex when customers operate file transfer workloads that share data across different internal […]
How Arc XP lowered data transfer costs by $500k per year with HAQM CloudFront and Lambda@Edge on AWS
The Washington Post, an American daily newspaper company, delivers digital news content using Arc XP’s digital experience platform. Arc XP originated in The Post and has grown into a Software-as-a-Service (SaaS) business used by publishers, broadcasters, and brands to create, host, and monetize engaging content for over 1,500 websites globally. Photo Center is an Arc […]
King Hamad University Hospital and Bahrain Oncology Center use HAQM S3 to store millions of medical images
King Hamad University Hospital (KHUH) and Bahrain Oncology Center is a 600-bed-hospital in Bahrain. Over a period of eleven years, KHUH accumulated around 1 million medical image studies, resulting in around 476 million files, with a total data volume of 48 TB. Read part 1 of the blog series to learn about the architecture King […]
Secure and process raw data transfers at scale with AWS Transfer Family
Ibexlabs is an AWS Advanced Consulting Partner with 100+ AWS certifications covering four competencies and seven service delivery programs. As an AWS Partner with competencies in AWS Security and AWS Level 1 Managed Security Services, and as an AWS Well-Architected Partner, Ibexlabs applies AWS best practices to design and build cloud solutions that meet the […]
Run queries up to 9x faster using Trino with HAQM S3 Select on HAQM EMR
UPDATE (7/25/2024): Use HAQM Athena, S3 Object Lambda, or client-side filtering to query your data in HAQM S3. Learn more » Customers building data lakes continue to innovate in the ways that they store and access their data. For these customers, performance is critical, particularly when they are accessing large amounts of data. For example, […]
Restoring archived objects at scale from the HAQM S3 Glacier storage classes
Update (7/26/2024): You no longer need to optimize the S3 Inventory report using HAQM Athena. HAQM S3 will automatically optimize your S3 Batch Operations restore job to achieve the fastest retrieval throughput. For more guidance on using batch operations, learn more in the S3 User Guide. Every organization around the world has archival data. There is […]
Using presigned URLs to identify per-requester usage of HAQM S3
Many software-as-a-service (SaaS) product offerings have a pay-as-you-go pricing model, charging customers only for the resources consumed. However, a pay-as-you-go pricing is only viable when you can accurately track each customer’s use of resources, such as compute capacity, storage, and networking bandwidth. Without this data, SaaS providers do not have visibility into resource consumption of […]
Customize file delivery notifications using AWS Transfer Family managed workflows
Enterprises and organizations that transfer files, both internally and with external parties, can benefit from having file-processing protocols that facilitate efficient and transparent file-transfer management. When transferring files, especially at scale, it is important to have visibility into the status of file transfer, and for you to able to process files as you receive them. […]