iPhone Agent: Control Your iOS Device with GPT-4.1

PhoneAgent is an iOS app leveraging OpenAI's GPT-4.1 model to control your iPhone across multiple apps. By accessing the accessibility tree, it can perform tasks like sending messages, downloading apps, and making calls. It uses Xcode's UI testing framework, requiring no jailbreak, but is experimental and has known limitations, such as handling long-running tasks and animations. The app sends app content to the OpenAI API and communicates with UI tests via a TCP server.