Tag: ELT

In this post we discuss how we can build and orchestrate in a few steps an ETL process for HAQM Redshift using HAQM S3 Event Notifications for automatic verification of source data upon arrival and notification in specific cases. And we show how to use AWS Step Functions for the orchestration of the data pipeline. It can be considered as a starting point for teams within organizations willing to create and build an event driven data pipeline from data source to data warehouse that will help in tracking each phase and in responding to failures quickly. Alternatively, you can also use HAQM Redshift auto-copy from HAQM S3 to simplify data loading from HAQM S3 into HAQM Redshift.

HAQM Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. You can start with just a few hundred gigabytes of data and scale to a petabyte or more. HAQM Redshift enables you to use your data to acquire new insights for your business and customers while keeping costs low. Together with price-performance, […]