Cloudflare Accuses Perplexity of Stealthily Scraping Websites

Cloudflare, a leading CDN provider, accuses AI startup Perplexity of bypassing websites' 'no crawl' directives using disguised web crawlers. Perplexity denies the accusations, claiming Cloudflare's analysis is flawed. Cloudflare has launched services to block aggressive AI crawlers and a pay-per-crawl program. This conflict highlights the tension between AI data acquisition and website rights, reflecting the challenges posed by AI technology.