AWS Big Data Blog

Category: HAQM Redshift

Simplify Management of HAQM Redshift Snapshots using AWS Lambda

NOTE: HAQM Redshift now supports creating an automatic snapshot schedule using the snapshot scheduler. For more information, please review this “What’s New” post. ———————————- Ian Meyers is a Solutions Architecture Senior Manager with AWS HAQM Redshift is a fast, fully managed, petabyte-scale data warehouse that makes it simple and cost-effective to analyze all your data […]

Real-time in-memory OLTP and Analytics with Apache Ignite on AWS

February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. Babu Elumalai is a Solutions Architect with AWS Organizations are generating tremendous amounts of data, and they increasingly need tools and systems that help them use this data to make decisions. The […]

Encrypt Your HAQM Redshift Loads with HAQM S3 and AWS KMS

Russell Nash is a Solutions Architect with AWS Have you been looking for a straightforward way to encrypt your HAQM Redshift data loads? Have you wondered how to safely manage the keys and where to perform the encryption? In this post, I will walk through a solution that meets these requirements by showing you how […]

HAQM Redshift UDF repository on AWSLabs

Christopher Crosbie is a Healthcare and Life Science Solutions Architect with HAQM Web Services Zach Christopherson, an HAQM Redshift Database Engineer, contributed to this post Did you ever have a need for complex string parsing in HAQM Redshift and wish you could simply add f_parse_url_query_string(url) to your SQL query? Have you ever tried to weigh which would be less […]

Query Routing and Rewrite: Introducing pgbouncer-rr for HAQM Redshift and PostgreSQL

This post was last reviewed and updated August, 2022 with a section on Deploying pgbouncer in Elastic Kubernetes Service (EKS). NOTE: You can now use federated queries in HAQM Redshift to query and analyze data across operational databases, data warehouses, and data lakes. For more information, please review the HAQM Redshift documentation article, “Querying Data […]

Migrating Metadata when Encrypting an HAQM Redshift Cluster

NOTE: HAQM Redshift now supports enabling and disabling encryption with 1-click. For more information, please review this “What’s New” post. ————————————— John Loughlin is a Solutions Architect with HAQM Web Services. A customer came to us asking for help expanding and modifying their HAQM Redshift cluster. In the course of responding to their request, we […]

Introduction to Python UDFs in HAQM Redshift

Christopher Crosbie is a Healthcare and Life Science Solutions Architect with HAQM Web Services When your doctor takes out a prescription pad at your yearly checkup, do you ever stop to wonder what goes into her thought process as she decides on which drug to scribble down? We assume that journals of scientific evidence coupled […]

Integrating HAQM Kinesis, HAQM S3 and HAQM Redshift with Cascading on HAQM EMR

This is a guest post by Ryan Desmond, Solutions Architect at Concurrent. Concurrent is an AWS Advanced Technology Partner. With HAQM Kinesis developers can quickly store, collate and access large, distributed data streams such as access logs, click streams and IoT data in real-time. The question then becomes, how can we access and leverage this […]