Epoch AI's FrontierMath: A Transparency Crisis with OpenAI
2025-01-20
Epoch AI's math benchmark, FrontierMath, was secretly funded by OpenAI, a fact only revealed after OpenAI's o3 model launch. This sparked controversy, as many mathematicians and contractors involved were unaware, and OpenAI had access to a significant portion of the dataset. Concerns arose about conflicts of interest and the potential use of the data for model training. Epoch AI admitted to a lack of transparency and pledged to improve future collaborations. The lack of clear communication and a verbal, rather than written, agreement regarding data usage further fueled the debate.