Posted On: Nov 17, 2023
HAQM OpenSearch Ingestion now allows you to migrate your data from Elasticsearch version 7.x clusters to the latest versions of HAQM OpenSearch Service managed clusters and both public and VPC serverless collections, eliminating the need for 3rd party tools like Logstash to migrate your data. This launch also enables you to migrate your data from 2.x version HAQM OpenSearch Service managed clusters to serverless collections. Additionally, you can now use HAQM OpenSearch Ingestion to replicate and migrate indexes between HAQM OpenSearch serverless collections.
You can now migrate all indexes, or just specific indexes, from one or more source clusters to one or more sink clusters. HAQM OpenSearch Ingestion will continually detect new indexes in the source cluster that need to be processed and can even be scheduled to reprocess indexes at a configurable interval to pick up on new documents. Also as part of this launch, HAQM OpenSearch Ingestion now supports Data Prepper 2.5.0, which introduces new processors like translate and dissect and adds support for update, upsert and delete actions for bulk operations when writing to HAQM OpenSearch indexes. You can check out the complete list of features in this blog post.
This feature is available in all the AWS commercial regions where HAQM OpenSearch Ingestion is currently available.
To learn more, see the HAQM OpenSearch Ingestion webpage and the HAQM OpenSearch Service Developer Guide.