AI Model Collapse: The Looming Threat of Data Contamination

The launch of OpenAI's ChatGPT in 2022 was a watershed moment for AI, comparable to the atomic bomb. Now, researchers warn of 'AI model collapse,' where AI models are trained on synthetic data created by other AI models, leading to unreliable results. This is likened to the contamination of metals by nuclear fallout, requiring 'low-background' materials. Researchers are advocating for access to pre-2022 data, considered 'clean,' to prevent this collapse and maintain competition. Policy solutions like mandatory labeling of AI-generated content and promoting federated learning are proposed to mitigate the risks of data contamination and monopolies.