AWS Open Source Blog

From Data Chaos to Cohesion: How OCSF is Optimizing Cyber Threat Detection

With the release of version 1.3.0, the Open Cybersecurity Schema Framework (OCSF) introduces several enhancements designed to further standardize and help streamline cybersecurity data management. OCSF is a collaborative, open source effort by AWS and leading partners in the cybersecurity industry, which provides a standard schema for common security events, defines versioning criteria to facilitate […]

Diving into OCI Image and Distribution 1.1 Support in HAQM ECR

AWS recently announced that HAQM Elastic Container Registry (HAQM ECR) now supports version 1.1 of the Open Container Initiative (OCI) Image and Distribution specifications. This latest version includes support for image referrers, as well as significant enhancements for distribution of non-image artifacts. We are excited about this set of new capabilities, which helps customers more […]

HAQM’s Exabyte-Scale Migration from Apache Spark to Ray on HAQM EC2

Large-scale, distributed compute framework migrations are not for the faint of heart. There are backwards-compatibility constraints to maintain, performance expectations to meet, scalability limits to overcome, and the omnipresent risk of introducing breaking changes to production. This all becomes especially troubling if you happen to be migrating away from something that successfully processes exabytes of […]

Getting Started with Cilium Service Mesh on HAQM EKS

Cilium is an open source solution for providing, securing, and observing network connectivity between workloads, powered by the revolutionary kernel technology called extended Berkeley Packet Filter (eBPF). eBPF enables the dynamic insertion of security, visibility, and networking logic into the Linux kernel. Cilium provides high-performance networking, advanced load balancing, transparent encryption, and observability. Cilium was […]

Build More Sustainable AWS Workloads with the Sustainability Scanner

Sustainability Scanner is an open source tool designed to help customers create a more sustainable infrastructure on AWS by evaluating your infrastructure as code against a set of sustainability best practices and suggested improvements to apply to your code.