Hacker News
- AI crawlers need to be more respectful https://about.readthedocs.com/blog/2024/07/ai-crawlers-abuse/ 118 comments
Linking pages
- Anthropic is scraping websites so fast it’s causing problems – Pivot to AI https://pivot-to-ai.com/2024/07/29/anthropic-is-scraping-websites-so-fast-its-causing-problems/ 24 comments
- A Sinister Brood of Web Crawlers is Hatching https://slamdunksoftware.substack.com/p/a-sinister-brood-of-web-crawlers 1 comment
Related searches:
Search whole site: site:about.readthedocs.com
Search title: AI crawlers need to be more respectful - Read the Docs
See how to search.