AWS News Blog

New chat experience for AWS Glue using natural language – HAQM Q data integration in AWS Glue (Preview)

Voiced by Polly

Today we’re previewing a new chat experience for AWS Glue that will let you use natural language to author and troubleshoot data integration jobs.

HAQM Q data integration in AWS Glue will reduce the time and effort you need to learn, build, and run data integration jobs using AWS Glue data integration engines. You can author jobs, troubleshoot issues, and get instant answers to questions about AWS Glue and anything related to data integration. The chat experience is powered by HAQM Bedrock.

You can describe your data integration workload and HAQM Q will generate a complete ETL script. You can troubleshoot your jobs by asking HAQM Q to explain errors and propose solutions. HAQM Q provides detailed guidance throughout the entire data integration workflow. HAQM Q helps you learn and build data integration jobs using AWS Glue. HAQM Q can help you connect to common AWS sources such as HAQM Simple Storage Service (HAQM S3), HAQM Redshift, and HAQM DynamoDB.

Let me show you some capabilities of HAQM Q data integration in AWS Glue.

1. Conversational Q&A capability

To start using this feature, I can select the HAQM Q icon on the right-hand side of the AWS Management Console.

HAQMQ-1

For example, I can ask, “What is AWS Glue,” and HAQM Q provides concise explanations along with references I can use to follow up on my questions and validate the guidance.

HAQMQ-2

With HAQM Q, I can elaborate on my use cases in more detail to provide context. For example, I can ask HAQM Q, “How do I create an AWS Glue job?”

HAQMQ-2

Next let me ask HAQM Q, “How do I optimize memory management in my AWS Glue job?”

HAQMQ-41

2. AWS Glue job creation

To use this feature, I can tell HAQM Q, “Write a Glue ETL job that reads from Redshift, drops null fields, and writes to S3 as parquet files.”

HAQMQ-Parq

I can copy code into the script editor or notebook with a simple click on the Copy button. I can also tell HAQM Q, “Help me with a Glue job that reads my DynamoDB table, maps the fields, and writes the results to HAQM S3 in Parquet format”.

HAQMQ-DynamoDB

Get started with HAQM Q today
With HAQM Q, you have an artificial intelligence (AI) expert by your side to answer questions, write code faster, troubleshoot issues, optimize workloads, and even help you code new features. These capabilities simplify every phase of building applications on AWS. HAQM Q data integration in AWS Glue is available in every region where HAQM Q is supported. To learn more, see the HAQM Q pricing page.

Learn more

— Irshad

Irshad Buchh

Irshad Buchh

Irshad A Buchh is a Principal Solutions Architect at HAQM Web Services (AWS), specializing in driving the widespread adoption of HAQM's cloud computing platform. He collaborates closely with AWS Global Strategic ISV and SI partners to craft and execute effective cloud strategies, enabling them to fully leverage the advantages of cloud technology. By working alongside CIOs, CTOs, and architects, Irshad assists in transforming their cloud visions into reality, providing architectural guidance and expertise throughout the implementation of strategic cloud solutions.