AWS S3's Strong Integrity Checksums Break Compatibility: OpenDAL to the Rescue?

2025-02-20

AWS S3's latest SDK update defaults to strong integrity checksums, a positive security step, but breaks compatibility with many S3-compatible services like Minio, Vast, and Dell EC. Projects such as Trino and Apache Iceberg are experiencing compatibility issues as a result, with Iceberg even submitting a PR to disable the feature. This highlights the risks of relying directly on S3 SDKs and shines a spotlight on OpenDAL. OpenDAL, by directly communicating with APIs, avoids SDK-related compatibility problems, offering users a more stable and reliable data access method.

Read more
Development

The Rise of Personal Software: Fueled by AI

2025-02-07

After a decade of developing software for others, the author experienced a burnout. The advent of AI has made building personal software easier than ever. This led the author to embrace the concept of 'personal' or 'selfish' software – focusing on solving their own problems and open-sourcing the projects. This approach reignites passion, allows for faster iteration, and leverages AI to efficiently learn and solve problems. Even small, one-off scripts become enjoyable, fostering a renewed sense of purpose in development.

Read more
Development personal software

Building a Link Blog: Inspired by Simon Willison

2025-02-04

Inspired by blogger Simon Willison, I've started a link blog to share interesting web links along with my personal comments and thoughts. Simon's blog is known for its AI content and high-quality links, where he adds personal insights and even code snippets, inspiring my approach to personal knowledge management and sharing. I used to struggle with the uniqueness and value of my posts, but Simon emphasizes the importance of consistent writing and accumulating work over time. My link blog will be a combination of public bookmarks and my commentary, aiming to enhance the reader's experience by adding context, connecting to related topics, and supplementing with background information or other sources.

Read more
Development link blog