Website Anti-Scraping: The Story Behind Anubis
2025-04-12
To combat aggressive web scraping by AI companies, an anti-scraping system called Anubis has been implemented. Anubis uses a Proof-of-Work (PoW) mechanism similar to Hashcash, adding minimal overhead for individual users but significantly increasing the cost for large-scale scrapers. This is a temporary solution; the ultimate goal is to identify and block headless browsers, thus avoiding the need for PoW for legitimate users. Note that Anubis requires modern JavaScript features; please disable plugins like JShelter for this domain.
Misc
anti-scraping