Filesystems: More Perilous Than You Think
A Deconstruct 2019 talk revealed shocking truths about filesystems: from the inconsistencies and difficulty of correctly using the file API, to serious bugs within filesystems themselves and the high error rates of disks, data corruption is rampant. The speaker delved into the atomicity issues of file writes and the challenges posed by different filesystem modes (e.g., ext3/ext4's data=journal, ordered, writeback). Even experienced programmers struggle to avoid mistakes leading to data loss or corruption. The talk also analyzed errors in popular databases and version control systems and suggested using databases instead of files to improve data reliability.
Read more