My Tiny Server vs. the AI Data Scraping Horde
2025-05-31
The author's personal website was hit with a massive data scraping attack, primarily from large tech companies like Amazon, Facebook, and OpenAI. Initially, resource consumption spiked, overwhelming the server. Using monitoring tools Zabbix and Loki, the author identified the problem and, by analyzing Nginx logs, pinpointed numerous malicious IPs and user agents. Ultimately, the author implemented a blacklist of user agents and IP address bans using Nginx configuration and Fail2Ban, effectively stopping the attack and restoring the website's functionality.
Read more
Development
server security