AI's Bottleneck: Data, Not Algorithms?

AI has seen incredible progress, but the pace seems to be slowing. This article argues that past major AI breakthroughs (DNNs, Transformers, RLHF, reasoning models) stemmed not from novel algorithms, but from unlocking new data sources (ImageNet, web text, human feedback, verifiers). The author suggests future breakthroughs will likely come not from algorithmic innovation, but from effectively utilizing new data sources like video and robotic sensors, as existing datasets may be approaching their knowledge limits.