AWS Database Blog
Category: HAQM Athena
Improve cost visibility of an HAQM RDS multi-tenant instance with Performance Insights and HAQM Athena
In this post we introduce a solution that addresses a common challenge faced by many customers: managing costs in multi-tenant applications, particularly for shared databases in HAQM Relational Database Service (HAQM RDS) and HAQM Aurora. This solution uses HAQM RDS Performance Insights and AWS Cost and Usage Reports (CUR) to addresses this challenge. This allows for efficient grouping of tenants within the same RDS or Aurora instances, while helping you implement accurate chargeback models, optimize resource-intensive workloads, and make data-driven decisions for capacity planning.
Analyze blockchain data with natural language using HAQM Bedrock
Data within public blockchain networks such as Bitcoin and Ethereum can be accessed by anyone. However, accessing and making sense of this information has traditionally been a complex and technical undertaking. Much of the data is encoded and stored as bytes, rather than in a human-readable format. In this post, we introduce a solution that demonstrates how you can chat with blockchain data using HAQM Bedrock and the AWS Public Blockchain datasets. We discuss HAQM Bedrock, review the solution architecture, provide example prompts, share interesting findings, and go over how you can extend the solution to integrate with different data sources.
Query RDF graphs using SPARQL and property graphs using Gremlin with the HAQM Athena Neptune connector
To query a Neptune database in Athena, you can use the HAQM Athena Neptune connector, an AWS Lambda function that connects to the Neptune cluster and queries the graph on behalf of Athena. In this post, we provide a step-by-step implementation guide to integrate the new version of the Athena Neptune connector and query a Neptune cluster using Gremlin and SPARQL queries.
Turn petabytes of relational database records into a cost-efficient audit trail using HAQM Athena, AWS DMS, HAQM RDS, and HAQM S3
In this post, we show how you can use AWS Database Migration Service (AWS DMS) to migrate relational data from HAQM RDS into compressed archives on HAQM S3. We discuss partitioning strategies for the resulting archive objects and how to use S3 Object Lock to protect the archive objects from modification. Lastly, we demonstrate how to query the archive objects using SQL syntax through Athena with seconds latency, even on large datasets.
Create a Virtual Knowledge Graph with HAQM Neptune and an HAQM S3 data lake
It’s common in an enterprise for data that logically fits together to be separated into different databases. Some data is better suited for one storage than another, and it may not be feasible to locate all your data in one data store. But this data often needs to be linked back together to provide a […]
Joining historical data between HAQM Athena and HAQM RDS for PostgreSQL
While databases are used to store and retrieve data, there are situations where applications should archive or purge the data to reduce storage costs or improve performance. However, there are often business requirements where an application must query both active data and archived data simultaneously. Developers need a solution that lets them benefit from using […]
Writing results from an Athena query to HAQM DynamoDB
Many industries are taking advantage of the Internet of Things (IoT) to track information from and about connected devices. One example is the energy industry, which is using smart electricity meters to collect energy consumption from customers for analytics and control purposes. Vector, a New Zealand energy company, combines its energy knowledge with HAQM Web […]
Export and analyze HAQM QLDB journal data using AWS Glue and HAQM Athena
HAQM Quantum Ledger Database (HAQM QLDB) is a fully managed ledger database that maintains a complete, immutable record of every change committed to the database. As transactions are committed to the database, they are appended to a transaction log called a journal and are cryptographically hash-chained to the previous transaction. Once committed, the record of […]
Access Bitcoin and Ethereum open datasets for cross-chain analytics
In this post, we share an open-source solution for running cross-chain analytics on public blockchain data along with public datasets for Bitcoin and Ethereum available through AWS Open Data. These datasets are still experimental and are not recommended for production workloads. You can find the open-source project on GitHub here and the public blockchain datasets […]
Build interactive graph data analytics and visualizations using HAQM Neptune, HAQM Athena Federated Query, and HAQM QuickSight
Customers have asked for a way to interact with graph datasets in HAQM Neptune using business intelligence (BI) tools such as HAQM QuickSight. Although some BI tools offer generic HTTP connectors that allow you to define a set of REST API calls to extract data from REST endpoints, you have to predefine either Gremlin or […]