Hacker News
- Go ahead and block AI web crawlers https://coryd.dev/posts/2024/go-ahead-and-block-ai-web-crawlers/ 22 comments
Linking pages
Linked pages
- https://www.reuters.com/technology/reddit-ai-content-licensing-deal-with-google-sources-say-2024-02-22/ 77 comments
- Dark Visitors – A List of Known AI Agents on the Internet https://darkvisitors.com 67 comments
- The New York Times blocks OpenAI’s web crawler - The Verge https://www.theverge.com/2023/8/21/23840705/new-york-times-openai-web-crawler-ai-gpt 19 comments
- Now you can block OpenAI’s web crawler - The Verge https://www.theverge.com/2023/8/7/23823046/openai-data-scrape-block-ai 3 comments
Related searches:
Search whole site: site:coryd.dev
Search title: Go ahead and block AI web crawlers • Cory Dransfeldt
See how to search.