Skip to main content

HAQM SageMaker Data Processing

HAQM SageMaker Data Processing FAQs

Page topics

General
3
Migration and access
3
Pricing
1

General

Open all

SageMaker Data Processing analyzes, prepares, integrates and orchestrates your data with processing capabilities from HAQM Athena, HAQM EMR, AWS Glue, and HAQM Managed Workflows for Apache Airflow (HAQM MWAA). You can use open source data-processing frameworks such as Apache Spark, analyze data at scale with Trino, and seamlessly build real-time analytics with Apache Flink and Apache Spark.

SageMaker Data Processing brings together HAQM EMR, Athena, AWS Glue, and HAQM MWAA.

SageMaker Data Processing helps you explore data, build data-transformation jobs, orchestrate, and deploy data pipelines at scale. It improves performance, driving faster insights than traditional open source systems with cost-effective and open source API-compatible versions of Apache Spark, Apache Airflow, Apache Flink, Trino, and more. SageMaker Data Processing provides access to your data sources in HAQM SageMaker Lakehouse through zero-ETL integrations, federated querying capabilities, and connectors.

Migration and access

Open all

No, you do not need to migrate to SageMaker. You can continue to use HAQM EMR, Athena, AWS Glue, and HAQM MWAA as you do today. However, we recommend that you get started with SageMaker to use unified tooling, built-in data governance, and simplified SageMaker Lakehouse architectures.

There is no impact to current code, queries, jobs, and other resources that you’ve created and used with HAQM EMR, Athena, or AWS Glue. You can continue to use these services for new workloads, if you prefer. Resources created in these services, such as HAQM EMR on HAQM Elastic Compute Cloud (HAQM EC2) clusters, are visible in SageMaker to simplify the development of analytics and AI applications. Existing development experiences built into HAQM EMR, AWS Glue, and Athena will continue to exist in addition to a new development experience within SageMaker.

The latest version of AWS Glue, AWS Glue 5.0, is available in SageMaker. AWS Glue 5.0 accelerates data-processing workloads and delivers the latest performance-optimized Apache Spark 3.5.2 runtime so you can develop, run, and scale for faster insights. To learn more, visit AWS Glue.

Pricing

Open all

Each AWS service that you use through SageMaker is subject to its own individual pricing. For more details, please consult the AWS pricing page for Athena, HAQM EMR, AWS Glue, and HAQM MWAA.