Generative AI's Limitations: A Critique by Gary Marcus

Cognitive scientist Gary Marcus is a prominent skeptic of generative AI, arguing that the current technological path suffers from technical and ethical flaws. He points out that Large Language Models (LLMs) excel at function approximation but fall short in learning functions, prone to "distribution shift" issues, and unable to understand abstract concepts or reliably follow instructions. Marcus contends that LLMs lack understanding of the real world, leading to logical errors and biases. He proposes integrating neural networks with classical AI methods to address these shortcomings. He introduces a new evaluation benchmark—the "comprehension challenge"—where an AI system should be able to understand a movie plot and answer related questions, measuring true comprehension.