AWS Big Data Blog
Category: Security, Identity, & Compliance
Implement a full stack serverless search application using AWS Amplify, HAQM Cognito, HAQM API Gateway, AWS Lambda, and HAQM OpenSearch Serverless
Designing a full stack search application requires addressing numerous challenges to provide a smooth and effective user experience. This encompasses tasks such as integrating diverse data from various sources with distinct formats and structures, optimizing the user experience for performance and security, providing multilingual support, and optimizing for cost, operations, and reliability. HAQM OpenSearch Serverless […]
Simplify data lake access control for your enterprise users with trusted identity propagation in AWS IAM Identity Center, AWS Lake Formation, and HAQM S3 Access Grants
Many organizations use external identity providers (IdPs) such as Okta or Microsoft Azure Active Directory to manage their enterprise user identities. These users interact with and run analytical queries across AWS analytics services. To enable them to use the AWS services, their identities from the external IdP are mapped to AWS Identity and Access Management […]
Use your corporate identities for analytics with HAQM EMR and AWS IAM Identity Center
To enable your workforce users for analytics with fine-grained data access controls and audit data access, you might have to create multiple AWS Identity and Access Management (IAM) roles with different data permissions and map the workforce users to one of those roles. Multiple users are often mapped to the same role where they need […]
Simplify access management with HAQM Redshift and AWS Lake Formation for users in an External Identity Provider
Many organizations use identity providers (IdPs) to authenticate users, manage their attributes, and group memberships for secure, efficient, and centralized identity management. You might be modernizing your data architecture using HAQM Redshift to enable access to your data lake and data in your data warehouse, and are looking for a centralized and scalable way to […]
Build SAML identity federation for HAQM OpenSearch Service domains within a VPC
HAQM OpenSearch Service is a fully managed search and analytics service powered by the Apache Lucene search library that can be operated within a virtual private cloud (VPC). A VPC is a virtual network that’s dedicated to your AWS account. It’s logically isolated from other virtual networks in the AWS Cloud. Placing an OpenSearch Service […]
Integrate Identity Provider (IdP) with HAQM Redshift Query Editor V2 and SQL Client using AWS IAM Identity Center for seamless Single Sign-On
October 2024: This post was reviewed and updated to update SQL Client setup instructions. AWS IAM Identity Center allows you to manage single sign-on (SSO) access to all your AWS accounts and applications from a single location. We are pleased to announce that HAQM Redshift now integrates with AWS IAM Identity Center, and supports trusted identity propagation, allowing you […]
Introducing shared VPC support on HAQM MWAA
In this post, we demonstrate automating deployment of HAQM Managed Workflows for Apache Airflow (HAQM MWAA) using customer-managed endpoints in a VPC, providing compatibility with shared, or otherwise restricted, VPCs. Data scientists and engineers have made Apache Airflow a leading open source tool to create data pipelines due to its active open source community, familiar […]
HAQM MSK IAM authentication now supports all programming languages
The AWS Identity and Access Management (IAM) authentication feature in HAQM Managed Streaming for Apache Kafka (HAQM MSK) now supports all programming languages. Administrators can simplify and standardize access control to Kafka resources using IAM. This support is based on SASL/OUATHBEARER, an open standard for authorization and authentication. Both HAQM MSK provisioned and serverless cluster […]
Enhance your security posture by storing HAQM Redshift admin credentials without human intervention using AWS Secrets Manager integration
HAQM Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. You can start with just a few hundred gigabytes of data and scale to a petabyte or more. Today, tens of thousands of AWS customers—from Fortune 500 companies, startups, and everything in between—use HAQM Redshift to run mission-critical business intelligence (BI) dashboards, […]
Set up fine-grained permissions for your data pipeline using MWAA and EKS
This blog post shows how to improve security in a data pipeline architecture based on HAQM Managed Workflows for Apache Airflow (HAQM MWAA) and HAQM Elastic Kubernetes Service (HAQM EKS) by setting up fine-grained permissions, using HashiCorp Terraform for infrastructure as code.