AI Intelligence Tests: Are Good Questions More Important Than Great Answers?
2025-03-27
The author took the "Humanity's Last Exam," a test designed to assess AI intelligence, and failed miserably. This led him to reflect on how we evaluate AI intelligence: current tests overemphasize providing correct answers to complex questions, neglecting the importance of formulating meaningful questions. True historical research begins with unique, unexpected questions that reveal new perspectives. The author argues that AI progress may not lie in perfectly answering difficult questions, but in its ability to gather and interpret evidence during research and its potential to ask novel questions. This raises the question of whether AI can ever produce valuable historical questions.