AWS Storage Blog
NEW HAQM S3 sessions at AWS re:Invent are coming on Jan 12-14
UPDATE 9/8/2021: HAQM Elasticsearch Service has been renamed to HAQM OpenSearch Service. See details.
We are into week two of AWS re:Invent, and a lot of the HAQM S3 sessions we posted about are now available on-demand, with a few more to be broadcast over the next two weeks. Hopefully, you also heard about some of the major announcements for HAQM S3, including strong read-after-write consistency, replication to multiple destinations, support for two-way replication, and S3 Bucket Keys which reduce the cost server-side encryption by up to 99%.
It’s been a big start to re:Invent, but WAIT, THERE IS MORE!
You may have noticed that there was a curious time range in the initial re:Invent calendar for January 12-14, but there were not any sessions in the catalog for that timeframe, what was that about? Well, we wanted to kickstart 2021 with some exceptional content, and the session catalog has been updated in a BIG way. We just released 13 new HAQM S3 sessions for Jan 12-14, and all are highlighted below. These range from sessions covering S3 Storage Lens (Check this out!), to securing your HAQM s3 data, and how to optimize your storage costs, we are sure there is something for everyone.
Take a look, sign-up for the scheduled broadcast to ask questions of AWS Experts, or come back and watch sessions on-demand! Next, we will post a blog highlighting all of the launches of 2020 for HAQM S3, and how you can get started with each one. Stay tuned!
Optimizing and managing HAQM S3 sessions
Bytes to insights: Analyze and take action on your storage usage: As you use HAQM S3 to manage large shared datasets across tens to hundreds of accounts and buckets and multiple AWS Regions, it becomes more and more important to gather complete and up-to-date information about your storage to make decisions or implement optimizations. HAQM S3 offers a range of tools to aid in analysis and optimization of your storage. In this session, take a tour of HAQM S3 Storage Class Analysis, HAQM S3 Inventory, and the newly launched, HAQM S3 Storage Lens to learn valuable tips for how to optimize your storage and apply best practices to manage your data.
- JAN 12, 2021 | 11:45 AM – 12:15 PM EST
- Featured speaker: Mark Kalus, Principal Product Manager, HAQM S3
Better, faster, and lower-cost storage: Optimizing HAQM S3: Effective performance and cost optimization can require different approaches depending on application latency and access patterns. This session reviews key considerations for storing data in frequently accessed, infrequently accessed, and long-term backup and archive storage classes. Learn how HAQM S3 powers some of the most performance-sensitive workloads running in the cloud today. Finally, review how to get the most out of HAQM S3 to improve your architecture and enhance performance.
- JAN 12, 2021 | 2:45 PM – 3:15 PM EST
- Featured speaker: Matt Sidley, Senior Product Manager, HAQM S3
Best practices for archiving large datasets with AWS: The vast majority of data in the world is cold. Using HAQM S3 Glacier, businesses can safely and securely store data for years or decades without worrying about expensive and finicky tape drives or off-premises tape archival services. This session covers the unique challenges for managing cold data as well as best practices for migrating your data into and restoring your data from the HAQM S3 Glacier and HAQM S3 Glacier Deep Archive storage classes. You will learn about different options for ingesting and restoring your data at petabyte scale while taking into consideration cost and different tiers of performance.
- JAN 12, 2021 | 5:00 PM – 5:30 PM EST
- Featured speaker: Matt Jordan, Senior Software Development Engineer, HAQM S3
Achieving unparalleled scale on HAQM S3: Manage and analyze your data: As your dataset grows on HAQM S3 to millions of objects and petabytes of data or more, it becomes increasingly valuable to use tools and automation to handle that scale. HAQM S3 offers flexible management capabilities to classify, report, and visualize your data usage trends so that you can make informed decisions to optimize performance and cost. In this session, you learn how to use HAQM S3 management features to help you better understand, optimize, and perform actions across storage at scale. Learn how to create and manage S3 Replication rules, run S3 Batch Operations, configure HAQM S3 inventory and metrics, and more.
- JAN 13, 2021 | 6:30 PM – 7:00 PM EST
- Featured speaker: Lee Kear, Solution Architect, HAQM S3
Extend HAQM S3 to on-premises environments with AWS Outposts: AWS Outposts extends HAQM S3 to your on-premises and connected edge environments to support applications with data residency requirements. Learn how you can use HAQM S3 on AWS Outposts to create and manage object storage running on premises. AWS Outposts brings native AWS services, infrastructure, and operating models to virtually any data center, colocation space, or on-premises facility. This session covers how you can use the same HAQM S3 capabilities that you use today in the cloud to easily set up, operate, scale, and manage storage running on AWS Outposts in your data centers. Attend this session to learn more about how HAQM S3 on Outposts works and key use cases.
- JAN 13, 2021 | 12:45 PM – 1:15 PM EST
- Featured speaker: Paul Reed, Principal Product Manager, AWS
HAQM S3 to AWS Lambda: A flexible pattern at the core of serverless apps: It’s not just image resizing! In this session, see how to use HAQM S3 as an event source for the core of your application workflow, including language translation, transcription, data processing, and content management. This session walks through the architectures, discusses how these applications work, and provides code repos you can use to build your own scalable production applications.
- JAN 14, 2021 | 11:15 AM – 11:45 AM EST
- Featured speaker: James Beswick, AWS Senior Developer Advocate
S3 security and access control best practices sessions
A defense-in-depth approach to HAQM S3 security and access: Strong adherence to architecture best practices and proactive controls is the foundation of storage security and access controls. In this session, you learn best practices for data security in HAQM S3. The session reviews the fundamentals of HAQM S3 security architecture and dives deep into the latest enhancements in usability and functionality. You learn about options for encryption, access control, security monitoring, auditing, and remediation.
- JAN 14, 2021 | 12:00 PM – 12:30 PM EST
- Featured speaker: Paul Meighan, Senior manager, product management, HAQM S3
Protecting sensitive data with HAQM Macie and HAQM GuardDuty: As organizations manage growing volumes of data, identifying and protecting your sensitive data can become increasingly complex, expensive, and time-consuming. In this session, learn how HAQM Macie and HAQM GuardDuty together provide protection for your data stored in HAQM S3. HAQM Macie automates the discovery of sensitive data at scale and lowers the cost of protecting your data. HAQM GuardDuty continuously monitors and profiles S3 data access events and configurations to detect suspicious activities. Come learn about these security services and how to best use them for protecting data in your environment.
- JAN 12, 2021 | 2:00 PM – 2:30 PM EST
- Featured speaker: Himanshu Verma, AWS Speaker
Closing the lid on public S3 buckets: Preventing S3 bucket exposure – Part 1: In Part 1 of this session, discovery ways that your infrastructure is being used, and explores the steps you can take to enable the public access block feature on all HAQM S3 buckets within your organization. This session discusses how the HAQM S3 public access block feature works and the building blocks required to enable it at scale with minimal to no disruption. Explore how to get visibility into what’s happening within your buckets. Finally, explore patterns and anti-patterns for using S3 buckets within your organization.
- JAN 13, 2021 | 12:30 PM – 1:00 PM EST
- Featured speakers: Prateek Sharma, AWS Speaker, and Mike Grima, Sr Security Software Engineer – Netflix Inc.
Closing the lid on public S3 buckets: Preventing S3 bucket exposure – Part 2: In Part 2 of this session, learn how to query S3 access logs for interesting findings, detect which objects are being publicly accessed, and lock objects down without causing serious disruption to your infrastructure operations. Explore patterns to follow when developing tooling to enable and enforce the HAQM S3 public access block feature at scale.
- JAN 13, 2021 | 4:15 PM – 4:45 PM EST
- Featured speakers: Prateek Sharma, AWS Speaker, and Mike Grima, Sr Security Software Engineer – Netflix Inc.
Secure your file transfers to HAQM S3 over SFTP, FTPS, and FTP: In this session, you learn how AWS Transfer Family provides fully managed support for file transfers directly into and out of HAQM S3. With support for SFTP, FTPS, and FTP, AWS Transfer Family helps you seamlessly migrate your file transfer workflows to AWS by integrating with existing authentication systems. It also provides DNS routing with HAQM Route 53 so that nothing changes for your customers and partners or their applications. Learn how, with your data in HAQM S3, you can use it with AWS services for processing, analytics, machine learning, and archiving.
- JAN 13, 2021 | 2:45 PM – 3:15 PM EST
- Featured speaker: Smitha Sriram, AWS Speaker
Event-driven data security using HAQM Macie: HAQM Macie sensitive data discovery jobs for HAQM S3 buckets help you discover sensitive data such as personally identifiable information (PII), financial information, account credentials, and workload-specific sensitive information. In this session, you learn about an automated approach to discover sensitive information whenever changes are made to the objects in your S3 buckets. You also learn about how to optimize sensitive information discovery as well as align and maintain compliance with your data security and privacy by minimizing the classified information disclosure in S3 using one-time, scheduled, and event-driven sensitive data discovery jobs.
- JAN 14, 2021 | 11:00 AM – 11:30 AM EST
- Featured speaker: Neha Joshi, AWS
Data lake on HAQM S3 sessions
An introduction to data lakes and analytics on AWS: As data volumes grow exponentially, so do the costs to store and analyze that data. AWS data lakes and analytics provide the broadest and deepest portfolio of purpose-built analytics tools so you can quickly get insights from data using the most appropriate tool for the job. This session provides an overview of the major analytics services—including HAQM Redshift, HAQM EMR, and HAQM ES—walks you through which services fit various analytics use cases, and provides an introductory demo. Gain a better understanding in this session of where to begin or how you can keep growing with AWS analytics.
- JAN 12, 2021 | 11:15 AM – 11:45 AM EST
- Featured speakers: Francis Jayakumar, AWS Analytics, and Anna Coniglio, AWS Solution Architect
How Twilio scaled business intelligence with a data lake powered by AWS: Twilio has democratized communications channels like voice, text, chat, video, and email by virtualizing the world’s communications infrastructure with APIs. Twilio’s business intelligence platform provides a 360-degree view of the business and is foundational to company-wide decision-making. The complexities of integrating new acquisitions (SendGrid), third-party applications, and growing volumes and varieties of data continue to challenge this platform. In this session, learn how Twilio has adapted to these growing needs by leveraging AWS managed services like HAQM Redshift, HAQM ElastiCache, and HAQM S3 to scale its data lake for improved reliability, performance, cost-effectiveness, and operational excellence.
- JAN 12, 2021 | 1:30 PM – 2:00 PM EST
- Featured speakers: Vaidy Krishnan, AWS Solution Architect, Dhara Patel, Director of Engineering – Twilio, Rahul Chandel, Engineering Manager – Twilio
Until next time! Looking forward to your feedback, and don’t forget to ask us questions directly in the sessions by using the “Ask the AWS Experts” button. Thanks!