AWS Database Blog

Category: Analytics

Tune replication performance with AWS DMS for an HAQM Kinesis Data Streams target endpoint – Part 3

In Part 1 of this series, we discussed the high-level architecture of multi-threaded full load and change data capture (CDC) settings to tune related parameters for better performance to replicate data to an HAQM Kinesis Data Streams target using AWS Database Migration Service (AWS DMS). In Part 2, we provided some examples of how we […]

Tune replication performance with AWS DMS for an HAQM Kinesis Data Streams target endpoint – Part 2

In Part 1 of this series, we discussed the architecture of multi-threaded full load and change data capture (CDC) settings, and considerations and best practices for configuring various parameters when replicating data using AWS Database Migration Service (AWS DMS) from a relational database system to HAQM Kinesis Data Streams. In this post, we demonstrate the […]

Tune replication performance with AWS DMS for an HAQM Kinesis Data Streams target endpoint – Part 1

AWS Database Migration Service (AWS DMS) makes it possible to replicate to HAQM Kinesis Data Streams from relational databases, data warehouses, NoSQL databases, and other types of data stores. You can use Kinesis data streams to collect and process large streams of data records in real time. Replicating data changes to a Kinesis data stream […]

Handle tables without primary keys while creating HAQM Aurora MySQL or HAQM RDS for MySQL zero-ETL integrations with HAQM Redshift

At AWS, we have been making steady progress towards bringing our zero-ETL vision to life. With HAQM Aurora zero-ETL integration to HAQM Redshift, you can bring together the transactional data of HAQM Aurora with the analytics capabilities of HAQM Redshift. The integration helps you derive holistic insights across many applications, break data silos in your […]

Handle tables without primary keys while creating HAQM Aurora PostgreSQL zero-ETL integrations with HAQM Redshift

At HAQM Web Services (AWS), we have been making steady progress towards bringing our zero-extract, transform, and load (ETL) vision to life. With HAQM Aurora zero-ETL integration to HAQM Redshift, you can bring together the transactional data of HAQM Aurora with the analytics capabilities of HAQM Redshift. The integration helps you derive holistic insights across […]

AWS tools to optimize your HAQM RDS costs

Customers are actively exploring opportunities to optimize their expenses, aligning with the Cost Optimization pillar of the AWS Well-Architected Framework. In this post, we discuss the following tools that you can use to analyze your spend and optimize your HAQM Relational Database Service (HAQM RDS) costs.

Run complex queries on massive amounts of data stored on your HAQM DocumentDB clusters using Apache Spark running on HAQM EMR

In this post, we demonstrate how to set up HAQM EMR to run complex queries on massive amounts of data stored in your HAQM DocumentDB (with MongoDB compatibility) clusters using Apache Spark. HAQM DocumentDB (with MongoDB compatibility) is a fully managed native JSON document database that makes it easy and cost effective to operate critical document […]

Create a Virtual Knowledge Graph with HAQM Neptune and an HAQM S3 data lake

It’s common in an enterprise for data that logically fits together to be separated into different databases. Some data is better suited for one storage than another, and it may not be feasible to locate all your data in one data store. But this data often needs to be linked back together to provide a […]

Understand and optimize replication for HAQM Redshift with AWS DMS

In this post, we deep dive into using AWS Database Migration Service (AWS DMS) to load data to HAQM Redshift and discuss how to optimize data loading. In a world where data is always growing and larger datasets need to be processed, it’s important to use the right tool for the right job. HAQM Redshift […]

Build a real-time, low-code anomaly detection pipeline for time series data using HAQM Aurora, HAQM Redshift ML, and HAQM SageMaker

The Industrial Internet of Things (IIOT) revolution has transformed the way various industries such as manufacturing and automobile work. Industry 4.0—also called the Fourth Industrial Revolution or 4IR—is the next phase in the digitization of the manufacturing sector, driven by disruptive trends including the rise of data and connectivity, analytics, human-machine interaction, and improvements in […]