AWS Big Data Blog
Tag: HAQM Kinesis Firehose
LaunchDarkly’s journey from ingesting 1 TB to 100 TB per day with HAQM Kinesis Data Streams
February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. This post was co-written with Mike Zorn, Software Architect at LaunchDarkly as the lead author. LaunchDarkly’s feature management platform enables customers to release features and measure their impact. As part of this […]
Creating customized Vega visualizations in HAQM Elasticsearch Service
This post shows how to implement Vega visualizations included in Kibana, which is part of HAQM Elasticsearch Service (HAQM ES), using a real-world clickstream data sample. Vega visualizations are an integrated scripting mechanism of Kibana to perform on-the-fly computations on raw data to generate D3.js visualizations. For this post, we use a fully automated setup using AWS CloudFormation to show how to build a customized histogram for a web analytics use case. This example implements an ad hoc map-reduce like aggregation of the underlying data for a histogram.
Stream data to an HTTP endpoint with HAQM Data Firehose
November 2024: This post was reviewed and updated for accuracy. The value of data is time sensitive. Streaming data services can help you move data quickly from data sources to new destinations for downstream processing. For example, HAQM Data Firehose can reliably load streaming data into data stores like HAQM Simple Storage Service (HAQM S3), HAQM Redshift, HAQM OpenSearch Service, and […]
How FactSet automated exporting data from HAQM DynamoDB to HAQM S3 Parquet to build a data analytics platform
February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. This is a guest post by Arvind Godbole, Lead Software Engineer with FactSet and Tarik Makota, AWS Principal Solutions Architect. In their own words “FactSet creates flexible, open data and software solutions […]
Your guide to HAQM Kinesis sessions, chalk talks, and workshops at AWS re:Invent 2018
February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. AWS re:Invent 2018 is almost here! This post includes a list of HAQM Kinesis sessions, chalk talks, and workshops at AWS re:Invent 2018. You can choose the link next to each session description for the […]
How I built a data warehouse using HAQM Redshift and AWS services in record time
Over the years, I have developed and created a number of data warehouses from scratch. Recently, I built a data warehouse for the iGaming industry single-handedly. To do it, I used the power and flexibility of HAQM Redshift and the wider AWS data management ecosystem. In this post, I explain how I was able to build a robust and scalable data warehouse without the large team of experts typically needed.
Optimize Delivery of Trending, Personalized News Using HAQM Kinesis and Related Services
Gunosy aims to provide people with the content they want without the stress of dealing with a large influx of information. We analyze user attributes, such as gender and age, and past activity logs like click-through rate (CTR). We combine this information with article attributes to provide trending, personalized news articles to users. In this post, I show you how to process user activity logs in real time using HAQM Kinesis Data Firehose, HAQM Kinesis Data Analytics, and related AWS services.
Visualize and Monitor HAQM EC2 Events with HAQM CloudWatch Events and HAQM Kinesis Firehose
February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. September 8, 2021: HAQM Elasticsearch Service has been renamed to HAQM OpenSearch Service. See details. Monitoring your AWS environment is important for security, performance, and cost control purposes. For example, by monitoring […]
Analyzing VPC Flow Logs using HAQM Athena, and HAQM QuickSight
February 2, 2022: Blog updated by Chaitanya Shah. February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. Organizations of different size who migrate their applications in cloud or applications born in cloud makes use of various cloud services to innovate and […]
Derive Insights from IoT in Minutes using AWS IoT, HAQM Kinesis Firehose, HAQM Athena, and HAQM QuickSight
February 9, 2024: HAQM Kinesis Data Firehose has been renamed to HAQM Data Firehose. Read the AWS What’s New post to learn more. Ben Snively is a Solutions Architect with AWS Speed and agility are essential with today’s analytics tools. The quicker you can get from idea to first results, the more you can experiment […]