OpenAI Bans Chinese Users for Using ChatGPT to Develop AI Surveillance Tool

2025-02-22
OpenAI Bans Chinese Users for Using ChatGPT to Develop AI Surveillance Tool

OpenAI banned a group of Chinese users for attempting to use ChatGPT to debug and edit code for an AI-powered social media surveillance tool. The tool monitored anti-Chinese sentiment on platforms like X, Facebook, and YouTube, with the intention of sharing insights with Chinese authorities. OpenAI detected the users' activities, noting their consistent use of ChatGPT during Chinese business hours and the high volume of prompts suggesting manual, rather than automated, operation. This marks the first time OpenAI has uncovered such an AI tool, raising concerns about the misuse of AI technology.