SourceHut Under Siege: The High Cost of LLM Crawlers

2025-03-18

SourceHut, an open-source code hosting platform, is under relentless attack from large-scale LLM crawlers. Ignoring robots.txt, these bots indiscriminately scrape data, causing frequent outages and severely impacting service stability and developer productivity. The author pleads for a halt to the development and use of LLMs and AI tools, condemning the immense damage inflicted on the open-source community. This isn't just SourceHut's problem; it's a challenge for the entire open-source ecosystem.

Development crawler attacks