AWS Big Data Blog
Category: HAQM DataZone
Cross-account data collaboration with HAQM DataZone and AWS analytical tools
In this post, we will cover how you can use HAQM DataZone to facilitate data collaboration between AWS accounts.
Governing streaming data in HAQM DataZone with the Data Solutions Framework on AWS
In this post, we explore how AWS customers can extend HAQM DataZone to support streaming data such as HAQM Managed Streaming for Apache Kafka (HAQM MSK) topics. Developers and DevOps managers can use HAQM MSK, a popular streaming data service, to run Kafka applications and Kafka Connect connectors on AWS without becoming experts in operating it.
How EUROGATE established a data mesh architecture using HAQM DataZone
In this post, we show you how EUROGATE uses AWS services, including HAQM DataZone, to make data discoverable by data consumers across different business units so that they can innovate faster. Two use cases illustrate how this can be applied for business intelligence (BI) and data science applications, using AWS services such as HAQM Redshift and HAQM SageMaker.
HEMA accelerates their data governance journey with HAQM DataZone
HEMA is a household Dutch retail brand name since 1926, providing daily convenience products using unique design. This post describes how HEMA used HAQM DataZone to build their data mesh and enable streamlined data access across multiple business areas. It explains HEMA’s unique journey of deploying HAQM DataZone, the key challenges they overcame, and the transformative benefits they have realized since deployment in May 2024. From establishing an enterprise-wide data inventory and improving data discoverability, to enabling decentralized data sharing and governance, HAQM DataZone has been a game changer for HEMA.
Implement a custom subscription workflow for unmanaged HAQM S3 assets published with HAQM DataZone
In this post, we demonstrate how to implement a custom subscription workflow using HAQM DataZone, HAQM EventBridge, and AWS Lambda to automate the fulfillment process for unmanaged data assets, such as unstructured data stored in HAQM S3. This solution enhances governance and simplifies access to unstructured data assets across the organization.
Building end-to-end data lineage for one-time and complex queries using HAQM Athena, HAQM Redshift, HAQM Neptune and dbt
In this post, we use dbt for data modeling on both HAQM Athena and HAQM Redshift. dbt on Athena supports real-time queries, while dbt on HAQM Redshift handles complex queries, unifying the development language and significantly reducing the technical learning curve. Using a single dbt modeling language not only simplifies the development process but also automatically generates consistent data lineage information. This approach offers robust adaptability, easily accommodating changes in data structures.
How ANZ Institutional Division built a federated data platform to enable their domain teams to build data products to support business outcomes
ANZ Institutional Division has transformed its data management approach by implementing a federated data platform based on data mesh principles. This shift aims to unlock untapped data potential, improve operational efficiency, and increase agility. The new strategy empowers domain teams to create and manage their own data products, treating data as a valuable asset rather than a byproduct. This post explores how the shift to a data product mindset is being implemented, the challenges faced, and the early wins that are shaping the future of data management in the Institutional Division.
Enhance data governance with enforced metadata rules in HAQM DataZone
We’re excited to announce a new feature in HAQM DataZone that offers enhanced metadata governance for your subscription approval process. Using this update, domain owners can define metadata requirements and enforce them on data consumers when they request subscriptions to data assets. By making it mandatory for data consumers to provide specific metadata, domain owners can achieve compliance, meet organizational standards, and support audit and reporting needs.
How Volkswagen Autoeuropa built a data solution with a robust governance framework, simplifying access to quality data using HAQM DataZone
This second post of a two-part series that details how Volkswagen Autoeuropa, a Volkswagen Group plant, together with AWS, built a data solution with a robust governance framework using HAQM DataZone to become a data-driven factory. Part 1 of this series focused on the customer challenges, overall solution architecture and solution features, and how they helped Volkswagen Autoeuropa overcome their challenges. This post dives into the technical details, highlighting the robust data governance framework that enables ease of access to quality data using HAQM DataZone.
How Volkswagen Autoeuropa built a data mesh to accelerate digital transformation using HAQM DataZone
In this post, we discuss how Volkswagen Autoeuropa used HAQM DataZone to build a data marketplace based on data mesh architecture to accelerate their digital transformation. The data mesh, built on HAQM DataZone, simplified data access, improved data quality, and established governance at scale to power analytics, reporting, AI, and machine learning (ML) use cases. As a result, the data solution offers benefits such as faster access to data, expeditious decision making, accelerated time to value for use cases, and enhanced data governance.