Website Anti-Scraping: How Anubis Works
2025-06-04
A website employs an anti-scraping mechanism called Anubis to combat large-scale data scraping by AI companies. Anubis uses a Proof-of-Work scheme similar to Hashcash, minimally impacting individual users but significantly increasing the cost for mass scraping, thus protecting website resources. Currently, Anubis serves as a temporary solution; the website plans to invest more in identifying headless browsers and other techniques for more precise malicious scraping prevention.
Tech