Top analytics announcements of AWS re:Invent 2022

Missed AWS re:Invent 2022? We’ve got you covered! 

AWS offers the most scalable, highest performing data services to keep up with the growing volume and velocity of data to help organizations to be data-driven in real-time. We help customers unify diverse data sources by investing in a zero ETL future. We provide the industry’s most comprehensive set of capabilities for an end-to-end data strategy for all your workloads. And, our services help you enable end-to-end data governance so your teams are free to move faster with data.

This post walks you through all of the new analytics service launches. You’ll find links to blog posts, announcements, session recordings, and press releases so you can dive deeper into those launches.

For more 2022 re:Invent recaps and ongoing coverage of all the important AWS launches, be sure to stay in touch with us here:

• Analytics at re:Invent: session recordings
• AWS Databases & Analytics online events: Analytics in 15, fireside chat, deep dive, and roadmap
• Top announcements of AWS re:Invent 2022: AWS VP and Chief Evangelist Jeff Barr’s picks for some of the most impactful launches

Press releases

Press release – AWS Announces Five New Database and Analytics Capabilities

This press release covers five new database and analytics capabilities that make it faster and easier for you to manage and analyze data at petabyte scale—HAQM DocumentDB Elastic Clusters, HAQM OpenSearch Serverless, HAQM Athena for Apache Spark, AWS Glue Data Quality, and HAQM Redshift Multi-AZ.

Press release – AWS Announced Five New Capabilities for HAQM QuickSight

This press release covers five new capabilities for HAQM QuickSight, the most popular serverless BI service built for the cloud. These new capabilities will help customers streamline business intelligence operations.

Press release – AWS Announced Two New Capabilities to Move Toward a Zero-ETL Future on AWS

This press release covers two new integrations that make it easier for customers to connect and analyze data across data stores without having to move data between services.

Press release – AWS Announced HAQM DataZone

HAQM DataZone makes it faster and easier for customers to catalog, discover, share, and govern data stored across AWS, on premises, and on third-party sources. To learn more about HAQM DataZone, please visit the product page or watch the re:Invent session recording.

Keynotes and leadership sessions

Adam Selipsky, Chief Executive Officer of HAQM Web Services, highlighted innovations in data, infrastructure, and more that are helping customers achieve their goals faster, take advantage of untapped potential, and create a better future with AWS. The analytics new launches Adam mentioned include HAQM OpenSearch Serverless, HAQM DataZone, and HAQM Aurora zero-ETL integration with HAQM Redshift.

Swami Sivasubramanian, Vice President of AWS Data and Machine Learning, revealed the latest AWS innovations that can help you transform your company’s data into meaningful insights and actions for your business. In this keynote, Swami launched HAQM Athena for Apache Spark, HAQM Redshift integration for Apache Spark, HAQM Redshift Multi-AZ, AWS Glue Data Quality, and other new AWS capabilities.

G2 Krishnamoorthy, VP of AWS Analytics, covered the latest service innovations around data and also highlighted customer successes with AWS analytics. New analytics capabilities he covered include AWS Glue for Ray, HAQM Redshift Streaming Ingestion, HAQM Aurora zero-ETL to HAQM Redshift, HAQM Redshift integration for Apache Spark, HAQM DataZone, HAQM Athena for Apache Spark, HAQM OpenSearch Serverless, HAQM QuickSight API, and more.

Mai-Lan Tomsen Bukovec, Vice President of AWS Foundational Data Services, and Andy Warfield, AWS Distinguished Engineer, shared the latest AWS storage innovations and an inside look at how customers drive modern business on data lakes and with high-performance data. They also dived deep into technical and organizational strategies that protect with resilience, respond with agility, and fuel innovations with data-driven insights on AWS storage.

HAQM DataZone

To gain value from your data, it needs to be accessible by people and systems that need it for analytics. This session introduces you to HAQM DataZone, a new AWS business data catalog that allows you to unlock data across organizational boundaries with built-in governance.

HAQM Security Lake

• Blog – Preview: HAQM Security Lake – A Purpose-Built Customer-Owned Data Lake Service
  This new service automatically centralizes your organization’s security data from cloud and on-premises sources into a purpose-built data lake stored in your account.

HAQM Redshift

• Blog – New for HAQM Redshift – Zero-ETL integration, simplified data ingestion techniques, security and reliability features.
  This year at re:Invent, HAQM Redshift has announced a number of features to help you simplify data ingestion and get to insights easily and quickly within a secure, reliable environment.
• Blog – New for HAQM Redshift – General Availability of Streaming Ingestion for Kinesis Data Streams and Managed Streaming for Apache Kafka
  HAQM Redshift Streaming Ingestion ingests hundreds of megabytes of data per second so you can query data in near real time. You can connect to multiple Kinesis Data Streams or HAQM Managed Streaming for Apache Kafka data streams and pull data directly to HAQM Redshift without staging data in HAQM S3.
• Blog – New – HAQM Redshift Integration with Apache Spark
  This new release makes it easy to build and run Spark applications on HAQM Redshift and Redshift Serverless, enabling you to open up the data warehouse for a broader set of AWS analytics and machine learning (ML) solutions.
• Blog – Simplify data ingestion from HAQM S3 to HAQM Redshift using auto-copy
  This feature simplifies data loading from HAQM S3 into HAQM Redshift. You can now set up continuous file ingestion rules to track your HAQM S3 paths and automatically load new files without needing additional tools or custom solutions.
• Blog – Centrally manage access and permissions for HAQM Redshift data sharing with AWS Lake Formation
  This feature enables you to centrally manage access to your HAQM Redshift datashares using Lake Formation. It opens up new design patterns and broadens governance and security posture across data warehouses.
• Blog – Simplify data loading on the HAQM Redshift console with Informatica Data Loader
  You need to bring data quickly and at scale from various data stores. You also need a simple, easy, and cloud-native solution to quickly onboard new data sources or to analyze recent data for actionable insights. With this feature, you can securely connect and load data to HAQM Redshift at scale via a simple and guided interface.

Watch the recording to learn about important new features of HAQM Redshift. Learn how HAQM Redshift reinvented data warehousing to help you analyze all your data across data lakes, data warehouses, and databases with the best price performance. In this session, Goldman Sachs shared their HAQM Redshift use case.

HAQM OpenSearch Service

• Blog – Run Search and Analytics Workloads without Managing Clusters
  This new release provisions and scales resources to deliver fast data ingestion and query responses for even the most demanding and unpredictable workloads, eliminating the need to configure and optimize clusters. Learn more by watching the recording of the re:Invent breakout session Provision & scale OpenSearch resources with serverless. To get started with HAQM OpenSearch Serverless, please join this workshop.

Streaming services

• Announcement – Introducing HAQM Managed Streaming for Apache Kafka (MSK) Delivery Partners
  The new HAQM MSK Service Delivery specialization for AWS partners helps customers migrate and build real-time streaming analytics solutions with fully managed Apache Kafka.
• Announcement – HAQM Kinesis Data Firehose adds support for data stream delivery to HAQM OpenSearch Serverless
  With a few clicks, you can easily ingest, transform, and reliably deliver streaming data into an HAQM OpenSearch Serverless without building and managing your own data ingestion and delivery infrastructure.

AWS Glue

• Blog – Join the Preview – AWS Glue Data Quality
  AWS Glue Data Quality can analyze your tables and recommend a set of rules automatically based on what it finds.
• Announcement – Announcing AWS Glue for Ray (Preview)
  Data engineers can use AWS Glue for Ray to process large datasets with Python and popular Python libraries.
• Blog – New AWS Glue 4.0 – New and Updated Engines, More Data Formats, and More
  This version of AWS Glue includes Python 3.10 and Apache Spark 3.3.0, plus native support for the Cloud Shuffle Storage Plugin for Apache Spark. It also includes Pandas support and more.
• Announcement – Introducing AWS Glue Delivery
  The new AWS Glue Delivery specialization validates AWS Partners with deep expertise and proven success in delivering AWS Glue for data integration, data pipeline, and data catalog use cases.
• Announcement – AWS Glue for Apache Spark Native support for Data Lake Frameworks
  AWS Glue for Apache Spark now supports three open-source data lake storage frameworks: Apache Hudi, Apache Iceberg, and Linux Foundation Delta Lake.
• Announcement – AWS Glue introduces custom visual transforms
  AWS Glue now offers custom visual transforms, which let customers define, reuse, and share business-specific ETL logic among their teams.

HAQM Athena

• Blog – New — HAQM Athena for Apache Spark
  With this feature, we can run Apache Spark workloads, use Jupyter Notebook as the interface to perform data processing on Athena, and programmatically interact with Spark applications using Athena APIs.

HAQM QuickSight

• Blog – New analytical questions available in HAQM QuickSight Q: “Why” and “Forecast”
  HAQM QuickSight announces support for two new question types that simplify and scale complex analytical tasks using natural language: “forecast” and “why.”
• Blog – Announcing Automated Data Preparation for HAQM QuickSight Q
  Automated data preparation uses machine learning to infer semantic information about data and adds it to datasets as metadata about the columns (fields), making it faster for you to prepare data in order to support natural language questions.
• Blog – New HAQM QuickSight API Capabilities to Accelerate Your BI Transformation
  New QuickSight API capabilities allow programmatic creation and management of dashboards, analysis, and templates.
• Blog – Create and Share Operational Reports at Scale with HAQM QuickSight Paginated Reports
  This feature allows customers to create and share highly formatted, personalized reports containing business-critical data to hundreds of thousands of end users—without any infrastructure setup or maintenance, up-front licensing, or long-term commitments.

HAQM AppFlow

• Blog – Announcing Additional Data Connectors for HAQM AppFlow
  We’ve added 22 new data connectors for HAQM AppFlow, including connectors for marketing, customer service and engagement, and business operations.

Thanks for reading! re:Invent is certainly not just about new launches. The Analytics and Business Intelligence tracks dived deep into each one of the analytics services through sessions (86 in total!), covering a wide range of topics and use cases.

Check out the YouTube playlist for session recordings.

About the author

Gwen Chen is Senior Product Marketing Manager for HAQM Redshift and re:Invent Analytics Track Lead. She believes in the power of communication, and likes data, analytics, and AI/ML.