S3's 19th Birthday: From Simple Object Store to Sophisticated Data Platform

2025-03-14
S3's 19th Birthday: From Simple Object Store to Sophisticated Data Platform

Amazon S3 celebrates its 19th birthday! This post chronicles S3's evolution from a simple object store to a sophisticated data platform. Driven by customer feedback, S3 continuously improves, exemplified by the launch of S3 Tables for enhanced tabular data handling and addressing limitations like increased bucket limits. The S3 team emphasizes 'simplicity,' aiming to let developers focus on business logic, not infrastructure, while continuously improving performance and elastic scalability to meet growing demands.

Read more
Tech

Amazon S3: Lessons Learned from 17 Years of Building a Massive Storage System

2025-02-25
Amazon S3: Lessons Learned from 17 Years of Building a Massive Storage System

This post summarizes Andy Warfield's keynote address at USENIX FAST ‘23, where he discussed the three perspectives on scale involved in building and operating a storage system the size of Amazon S3. Warfield shares his six-year experience at S3, covering everything from hard disk mechanics to customer experience. He details technical challenges like managing millions of hard drives, addressing hotspots, and leveraging replication and erasure coding for durability and performance. The article also highlights the importance of 'ownership', empowering teams to make decisions and foster innovation. A valuable read for anyone interested in large-scale distributed storage systems.

Read more
Tech