Amazon's AI Crawler DDoSing My Git Server
2025-01-18
Blogger Xe Iaso's Git server (gitea.xeserv.us) is under attack from Amazon's AI crawler, causing instability. Despite attempts to block the crawler using robots.txt and nginx configuration to filter specific user agents, the attacks continue with constantly changing IPs and spoofed user agents. As a last resort, the server was moved behind a VPN, and a proof-of-work reverse proxy is being developed for future protection. The post expresses frustration and anger at the resource consumption by the Amazon AI crawler, urging Amazon to stop the attacks or negotiate a solution.