AWS Database Blog
Category: HAQM Kinesis
Build a fault-tolerant, serverless data aggregation pipeline with exactly-once processing
The business problem of real-time data aggregation is faced by customers in various industries like manufacturing, retail, gaming, utilities, and financial services. In a previous post, we discussed an example from the banking industry: real-time trade risk aggregation. Typically, financial institutions associate every trade that is performed on the trading floor with a risk value […]
Build a near real-time data aggregation pipeline using a serverless, event-driven architecture
The collection, aggregation, and reporting of large volumes of data in near real time is a challenge faced by customers from many different industries, like manufacturing, retail, gaming, utilities, and financial services. In this post, we present a serverless aggregation pipeline in AWS. We start by defining the business problem, introduce a serverless architecture for […]
Filter HAQM Aurora database activity stream data for segregation and monitoring
Most organizations need to monitor activity on databases containing sensitive information to ensure security auditing and compliance. Although some security operations teams might be interested in monitoring all activities like read, write, and logons, others might want to restrict monitoring to activities that lead to changes in data and data structures only. In this post, […]
Near real-time processing with HAQM Kinesis, HAQM Timestream, and Grafana
August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. As organizations adopt and deploy home-connected smart devices, they face challenges utilizing device telemetry data in narrow and broad contexts. Examples of such home-connected devices are smart […]
HAQM QLDB data streaming via AWS CDK
HAQM Quantum Ledger Database (HAQM QLDB) is a fully managed ledger database that provides a transparent, immutable, and cryptographically verifiable transaction log. You can use HAQM QLDB to track each application data change, and it maintains a complete and verifiable history of changes over time. Because of those key features, banking customers have adopted HAQM QLDB as a database […]
How Zulily drives discovery shopping using HAQM Kinesis Data Analytics and HAQM DocumentDB
This is a guest post by Sergey Podlazov – Director of Engineering (Shopping Experience) at Zulily, Senthil Kumar, Sr. Solutions Architect, AWS, and Praveen Chamarthi, Sr. Technical Account Manager, AWS August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog […]
Creating HAQM Timestream interpolated views using HAQM Kinesis Data Analytics for Apache Flink
August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. Many organizations have accelerated their adoption of stream data processing technologies in an effort to more quickly derive actionable insights from their data. Frequently, it is required […]
Performing analytics on HAQM Managed Blockchain
Managed Blockchain follows an event-driven architecture. We can open up a wide range of analytic approaches by streaming events to HAQM Kinesis. For instance, we could analyze events in near-real time with Kinesis Data Analytics, perform petabyte scale data warehousing with HAQM RedShift, or use the Hadoop ecosystem with HAQM EMR. This allows us to use the right approach for every blockchain analytics use case.
In this post, we show you one approach that uses HAQM Kinesis Data Firehose to capture, monitor, and aggregate events into a dataset, and analyze it with HAQM Athena using standard SQL.
Accelerating Nylas’s feature development with AWS Data Lab
This is a guest post by David Ting, VP of Engineering at Nylas. In their own words, Nylas is a pioneer and leading provider of universal communications APIs that allow developers to quickly connect their applications to every email, calendar, or contacts provider in the world. Over 26,000 developers around the globe use the Nylas […]
Analyze user behavior using HAQM Elasticsearch Service, HAQM Kinesis Data Firehose and Kibana
September 8, 2021: HAQM Elasticsearch Service has been renamed to HAQM OpenSearch Service. See details. February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. Let’s assume that you work for an ecommerce company and you want to provide the best user […]