Harvard Releases Massive Free AI Training Dataset
2024-12-18
Harvard University, in collaboration with Microsoft and OpenAI, has released a massive AI training dataset comprising nearly 1 million public domain books. Created by Harvard's Institutional Data Initiative, this dataset aims to 'level the playing field' by providing smaller players and individual researchers access to high-quality training data previously only available to large tech companies. Similar to the impact of Linux, this resource, spanning various genres, decades, and languages, will fuel AI model development. However, companies will still need additional licensed data to differentiate their models.