AI Papers Dominate: The Unexpected Success of Deep Residual Networks

The most cited scientific papers of the 21st century aren't from groundbreaking discoveries like mRNA vaccines or gravitational waves. Nature's analysis of the top 25 most-cited papers reveals a dominance of AI methodology, research quality improvement, cancer statistics, and research software. Topping the list is Microsoft's 2016 paper on "Deep Residual Networks" (ResNets), which solved the vanishing gradient problem in deep learning, paving the way for AI tools like AlphaGo, AlphaFold, and ChatGPT. The paper's success is attributed to its open-source nature and the rapid advancement of the AI field. Highly cited papers on research methods, software tools, and cancer statistics also highlight the crucial role of methodology and foundational tools in scientific research.