AWS Storage Blog

Category: AWS Lambda

Easy-to-use HAQM EFS integrations with AWS Compute services

Every day AWS customers launch HAQM EC2 instances using the Launch Instance Wizard (LIW). When launching instances to host applications like content management systems, data science notebooks, database backups, media workflows, and code repositories, you create and attach shared file systems like HAQM EFS to your instances. In the past, creating and attaching new HAQM […]

AWS Transfer Family Featured Image

Enable password authentication for AWS Transfer Family using AWS Secrets Manager (updated)

This blog post was published as an update to another blog post, “Enable password authentication for AWS Transfer for SFTP using AWS Secrets Manager.” Update (1/25/2023): The format used for the AWS Secrets Manager entry has been changed to aws/transfer/server-id/username. This brings the format in-line with the requirements for pre-defined managed workflow like PGP decryption, […]

Online Tech Talk September 25: Modernize your applications with containers, serverless, and HAQM EFS

Don’t miss our AWS Online Storage Tech Talk on September 25, where an AWS expert covers modernizing your applications with containers, serverless, and HAQM EFS. This Tech Talk is at 1:00 PM – 2:00 PM PT (4:00 PM – 5:00 PM ET). Modernizing applications with containers and serverless improves agility, so you can innovate faster, […]

HAQM S3

Querying data without servers or databases using HAQM S3 Select

UPDATE (7/25/2024): Use HAQM Athena, S3 Object Lambda, or client-side filtering to query your data in HAQM S3. Learn more » In our time as Solutions Architects at AWS, we have supported all types of customers and use cases. We regularly hear the same feedback: instead of deploying and managing systems and infrastructure, customers want […]

HAQM S3

Query HAQM S3 Analytics data with HAQM Athena

I recently had a customer explain that they were aware of the benefits of various HAQM S3 storage classes, like S3 Standard, S3 Infrequent-Access, and S3 One-Zone Infrequent-Access, but they were not sure which tiers and lifecycle rules to apply to optimize their storage. This customer, and others like them, have multiple buckets and various […]

Automating HAQM EBS volume resizing with AWS Step Functions and AWS Systems Manager

In active applications, it’s possible for an HAQM EC2 instance’s HAQM EBS volume utilization to reach provisioned capacity. Depending on the application in use, this creates the risk of a customer-impacting application outage when that provisioned capacity is exhausted. One solution is to design a failover mechanism into the application. However, this can be a […]

Using AWS SFTP logical directories to build a simple data distribution service

We launched the AWS Transfer for SFTP (AWS SFTP) service in November of 2018, and it has since been adopted by many organizations to enable secure SFTP access to data hosted in HAQM S3. At AWS, we are continuously iterating on our services, and many of our customers have told us that they would like […]

HAQM S3 Batch Operations featured image

Transcoding video files with S3 Batch Operations

The ability to work quickly in bulk—to work smarter rather than harder—is vital for the practical storage management of modern video archives, which can easily be petabytes of data. S3 Batch Operations is an HAQM S3 feature that can perform actions like copying or tagging objects across millions or billions of objects with a single […]

Using Okta as an identity provider with AWS Transfer for SFTP

AWS Transfer for SFTP (AWS SFTP) is a fully managed service that enables you to move file transfer workloads to AWS when they use the Secure Shell File Transfer Protocol (SFTP). Enterprises and startups across a range of industries can use AWS SFTP without needing to modify applications or manage any SFTP servers. Data uploaded […]