AWS Big Data Blog
Category: HAQM Kinesis
Building a Near Real-Time Discovery Platform with AWS
September 8, 2021: HAQM Elasticsearch Service has been renamed to HAQM OpenSearch Service. See details. February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. Assaf Mentzer is a Senior Consultant for AWS Professional Services In the spirit of the U.S presidential […]
Integrating Splunk with HAQM Kinesis Streams
Prahlad Rao is a Solutions Architect wih AWS It is important to not only be able to stream and ingest terabytes of data at scale, but to quickly get insights and visualize data using available tools and technologies. The HAQM Kinesis platform of managed services enables continuous capture and stores terabytes of data per hour from […]
Persist Streaming Data to HAQM S3 using HAQM Data Firehose and AWS Lambda
February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. Streaming data analytics is becoming main-stream (pun intended) in large enterprises as the technology stacks have become more user-friendly to implement. For example, Spark-Streaming connected to an HAQM Kinesis stream is a […]
Integrating HAQM Kinesis, HAQM S3 and HAQM Redshift with Cascading on HAQM EMR
This is a guest post by Ryan Desmond, Solutions Architect at Concurrent. Concurrent is an AWS Advanced Technology Partner. With HAQM Kinesis developers can quickly store, collate and access large, distributed data streams such as access logs, click streams and IoT data in real-time. The question then becomes, how can we access and leverage this […]
Implementing Efficient and Reliable Producers with the HAQM Kinesis Producer Library
Kevin Deng is an SDE with the HAQM Kinesis team and is the lead author of the HAQM Kinesis Producer Library How do you vertically scale an HAQM Kinesis producer application by 100x? While it’s easy to get started with streaming data into HAQM Kinesis, streaming large volumes of data efficiently and reliably presents some […]
Presto-HAQM Kinesis Connector for Interactively Querying Streaming Data
This is a guest post by Sivaramakrishnan Narayanan, Member of Technical Staff at Qubole, and Xing Quan, Director of Product Management at Qubole. Qubole is an AWS Advanced Technology Partner. HAQM Kinesis is a scalable and fully managed service for streaming large, distributed data sets. As applications (particularly on mobile and wearable devices) start to […]
Processing HAQM Kinesis Stream Data Using HAQM KCL for Node.js
Manan Gosalia is an SDE for HAQM Kinesis This blog post shows you how to get started with the HAQM Kinesis Client Library (KCL) for Node.js. The Node.js framework uses an event-driven, non-blocking I/O model that makes it lightweight, efficient, and perfect for data-intensive, real-time applications that run across distributed devices. JavaScript is also simple […]
Streaming Analytics with DataTorrent RTS and HAQM EMR
Nick Durkin is a Senior Solution Engineer for DataTorrent. DataTorrent is an AWS Technology Partner. In this blog post, we introduce fast big data and provide context about the DataTorrent RTS streaming analytics platform. In addition, we show you how to implement a real-time, streaming analytics application for capturing social media trends from Twitter using […]
Snakes in the Stream – Feeding and Eating HAQM Kinesis Streams with Python
Markus Schmidberger is a Senior Consultant for AWS Professional Services The Internet of Things (IoT) is becoming increasingly popular, and it’s easy to see why: it generates new business value for your company by connecting all available machines and devices. The big challenge is real-time data processing and analysis. Cloud computing is an excellent way […]
Getting HBase Running on HAQM EMR and Connecting it to HAQM Kinesis
Wangechi Doble is an AWS Solutions Architect Introduction Apache HBase is an open-source, column-oriented, distributed NoSQL database that runs on the Apache Hadoop framework. In the AWS Cloud, you can choose to deploy Apache HBase on HAQM Elastic Compute Cloud (HAQM EC2) and manage it yourself or leverage Apache HBase as a managed service on […]