Playing Pokémon FireRed with GPT-4: An AI Adventure

This project details an attempt to get GPT-4 to autonomously play Pokémon FireRed using RetroArch. The author implemented methods for reading game memory, using OCR for text recognition, and creating a game memory database to allow the AI to explore, battle, and interact with NPCs. However, programmatic input control proved a major hurdle; RetroArch's UDP input system was unreliable, and keyboard-based input required window focus, limiting automation. Despite this, the project showcases the potential of AI in gaming and provides valuable insights into future LLM applications in this field.