Webtagr - Technology News Summarizer

AWS Aurora DSQL: A Database Architecture Revolution from JVM to Rust

2025-05-27

AWS announced Aurora DSQL at re:Invent, and this post delves into its development journey. To tackle the challenge of horizontally scaling writes in traditional databases, the AWS team initially used JVM but encountered severe performance bottlenecks, especially tail latency issues caused by garbage collection. They ultimately decided to rewrite the data plane in Rust, which significantly improved performance and reduced tail latency. Furthermore, the team also migrated the control plane to Rust, avoiding the complexities of multiple languages. This project demonstrates that questioning existing solutions and experimenting with new technologies (even costly language migrations) can yield significant rewards.

S3's 19th Birthday: From Simple Object Store to Sophisticated Data Platform

2025-03-14

Amazon S3 celebrates its 19th birthday! This post chronicles S3's evolution from a simple object store to a sophisticated data platform. Driven by customer feedback, S3 continuously improves, exemplified by the launch of S3 Tables for enhanced tabular data handling and addressing limitations like increased bucket limits. The S3 team emphasizes 'simplicity,' aiming to let developers focus on business logic, not infrastructure, while continuously improving performance and elastic scalability to meet growing demands.

Amazon S3: Lessons Learned from 17 Years of Building a Massive Storage System

2025-02-25

This post summarizes Andy Warfield's keynote address at USENIX FAST ‘23, where he discussed the three perspectives on scale involved in building and operating a storage system the size of Amazon S3. Warfield shares his six-year experience at S3, covering everything from hard disk mechanics to customer experience. He details technical challenges like managing millions of hard drives, addressing hotspots, and leveraging replication and erasure coding for durability and performance. The article also highlights the importance of 'ownership', empowering teams to make decisions and foster innovation. A valuable read for anyone interested in large-scale distributed storage systems.