AWS S3's Strong Integrity Checksums Break Compatibility: OpenDAL to the Rescue?

2025-02-20

AWS S3's latest SDK update defaults to strong integrity checksums, a positive security step, but breaks compatibility with many S3-compatible services like Minio, Vast, and Dell EC. Projects such as Trino and Apache Iceberg are experiencing compatibility issues as a result, with Iceberg even submitting a PR to disable the feature. This highlights the risks of relying directly on S3 SDKs and shines a spotlight on OpenDAL. OpenDAL, by directly communicating with APIs, avoids SDK-related compatibility problems, offering users a more stable and reliable data access method.

Development