AWS Big Data Blog

Category: Kinesis Data Streams

A serverless operational data lake for retail with AWS Glue, HAQM Kinesis Data Streams, HAQM DynamoDB, and HAQM QuickSight

Do you want to reduce stockouts at stores? Do you want to improve order delivery timelines? Do you want to provide your customers with accurate product availability, down to the millisecond? A retail operational data lake can help you transform the customer experience by providing deeper insights into a variety of operational aspects of your […]

Introducing Protocol buffers (protobuf) schema support in AWS Glue Schema Registry

AWS Glue Schema Registry now supports Protocol buffers (protobuf) schemas in addition to JSON and Avro schemas. This allows application teams to use protobuf schemas to govern the evolution of streaming data and centrally control data quality from data streams to data lake. AWS Glue Schema Registry provides an open-source library that includes Apache-licensed serializers […]

Make data available for analysis in seconds with Upsolver low-code data pipelines, HAQM Redshift Streaming Ingestion, and HAQM Redshift Serverless

HAQM Redshift is the most widely used cloud data warehouse. HAQM Redshift makes it easy and cost-effective to perform analytics on vast amounts of data. HAQM Redshift launched Streaming Ingestion for HAQM Kinesis Data Streams, which enables you to load data into HAQM Redshift with low latency and without having to stage the data in […]

How Cynamics built a high-scale, near-real-time, streaming AI inference system using AWS

This post is co-authored by Dr. Yehezkel Aviv, Co-Founder and CTO of Cynamics and Sapir Kraus, Head of Engineering at Cynamics. Cynamics provides a new paradigm of cybersecurity — predicting attacks long before they hit by collecting small network samples (less than 1%), inferring from them how the full network (100%) behaves, and predicting threats […]

Stream Apache HBase edits for real-time analytics

August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. Apache HBase is a non-relational database. To use the data, applications need to query the database to pull the data and changes from tables. In this post, […]

Integrate Etleap with HAQM Redshift Streaming Ingestion (preview) to make data available in seconds

HAQM Redshift is a fully managed cloud data warehouse that makes it simple and cost-effective to analyze all your data using SQL and your extract, transform, and load (ETL), business intelligence (BI), and reporting tools. Tens of thousands of customers use HAQM Redshift to process exabytes of data per day and power analytics workloads. Etleap […]

How MEDHOST’s cardiac risk prediction successfully leveraged AWS analytic services

February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. MEDHOST has been providing products and services to healthcare facilities of all types and sizes for over 35 years. Today, more than 1,000 healthcare facilities are partnering with MEDHOST and enhancing their […]

Secure multi-tenant data ingestion pipelines with HAQM Kinesis Data Streams and Kinesis Data Analytics for Apache Flink

August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. When designing multi-tenant streaming ingestion pipelines, there are myriad ways to design and build your streaming solution, each with its own set of trade-offs. The first decision […]

Streaming HAQM DynamoDB data into a centralized data lake

February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. August 30, 2023: HAQM Kinesis Data Analytics has been renamed to HAQM Managed Service for Apache Flink. Read the announcement in the AWS News Blog and learn more. For organizations moving towards […]

Use Grok patterns in AWS Glue to process streaming data into HAQM Elasticsearch Service

September 8, 2021: HAQM Elasticsearch Service has been renamed to HAQM OpenSearch Service. See details. Recently, we launched AWS Glue custom connectors for HAQM OpenSearch Service, which provides the capability to ingest data into HAQM OpenSearch Service with just a few clicks. You can now use HAQM OpenSearch Service as a data store for your […]