AWS Storage Blog

Tag: AWS Open Source

HAQM S3 Tables

Build a managed Apache Iceberg data lake using Starburst and HAQM S3 Tables

Managing large-scale data analytics across diverse data sources has long been a challenge for enterprises. Data teams often struggle with complex data lake configurations, performance bottlenecks, and the need to maintain consistent data governance while enabling broad access to analytics capabilities. Today, Starburst announces a powerful solution to these challenges by extending their Apache Iceberg […]

HAQM S3 featured image - new

Accelerate HAQM S3 throughput with the AWS Common Runtime

Data is at the center of every machine learning pipeline. Whether pre-training foundation models (FMs), fine-tuning FMs with business-specific data, or serving inference queries, every step of the machine learning lifecycle needs low-cost, high-performance data storage to keep compute resources busy and performing useful work. Customers use HAQM Simple Storage Service (HAQM S3) to store training data […]

HAQM S3 featured image - new

How Continental uses Mountpoint for HAQM S3 in autonomous driving development – accelerating simulation performance by 20%

Continental and AWS have been collaborating to create the Continental Automotive Edge (CAEdge) framework – a modular hardware and software environment that connects the vehicle to the cloud and features virtual workbenches. The platform includes a virtual workbench offering numerous options to develop, supply, and maintain software-intensive system functions. It supports a wide range of automotive […]

HAQM S3 featured image - new

The inside story on Mountpoint for HAQM S3, a high-performance open source file client

UPDATE (8/9/2023): Mountpoint for HAQM S3 is now generally available. For details, please read the What’s New post. HAQM S3 is the best place to build data lakes because of its durability, availability, scalability, and security. Hundreds of thousands of data lakes are built on S3, storing diverse sets of unstructured data for use in […]

New on the Open Source blog: Using the FSx for Lustre CSI Driver with HAQM EKS

From time to time the AWS Storage Blog will point you to storage related blog posts from other AWS blog channels that we think you will find interesting or helpful for your storage use cases. We wanted to share a post from the Open Source Blog that highlights a walk-through of using HAQM FSx for Lustre […]