AI Conquers Tetris 99: Computer Vision and DFS Secure First Place

Two programmers built "Jeff," an AI that plays Tetris 99 on the Nintendo Switch, using computer vision, a depth-first search algorithm, and a handcrafted utility function. Jeff captures the game screen via HDMI, analyzes the board state and upcoming pieces, and sends button commands to the Switch through a microcontroller. While initially aiming for webcam and Bluetooth control, they switched to an HDMI capture card and USB for simplicity. Overcoming challenges like visual effects and algorithm optimization, Jeff secured first place in a few games. The project highlights the power of combining computer vision and classical AI for real-time gameplay.