Hacker News
- Devs say AI crawlers dominate traffic, forcing blocks on entire countries https://arstechnica.com/ai/2025/03/devs-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries/ 250 comments
- Open Source devs say AI crawlers dominate traffic, forcing blocks on entire countries | AI bots hungry for data are taking down FOSS sites by accident, but humans are fighting back. https://arstechnica.com/ai/2025/03/devs-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries/ 17 comments technews
- Open Source devs say AI crawlers dominate traffic, forcing blocks on entire countries https://arstechnica.com/ai/2025/03/devs-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries/ 15 comments artificial
- AI crawler swarms push open source projects to breaking point, developers warn | AI bots hungry for data are taking down sites by accident, but humans are fighting back https://arstechnica.com/ai/2025/03/devs-say-ai-crawlers-dominate-traffic-forcing-blocks-on-entire-countries/ 2 comments technology
Linked pages
- FOSS infrastructure is under attack by AI companies https://thelibre.news/foss-infrastructure-is-under-attack-by-ai-companies/ 761 comments
- Excerpt from a message I just posted in a #diaspora team internal f... https://pod.geraspora.de/posts/17342163 508 comments
- The I in LLM stands for intelligence | daniel.haxx.se https://daniel.haxx.se/blog/2024/01/02/the-i-in-llm-stands-for-intelligence/ 460 comments
- Cloudflare turns AI against itself with endless maze of irrelevant facts - Ars Technica https://arstechnica.com/ai/2025/03/cloudflare-turns-ai-against-itself-with-endless-maze-of-irrelevant-facts/ 418 comments
- VC&G | » The PC is Dead: It’s Time to Make Computing Personal Again https://www.vintagecomputing.com/index.php/archives/3292/the-pc-is-dead-its-time-to-make-computing-personal-again 368 comments
- Amazon's AI crawler is making my git server unstable - Xe Iaso https://xeiaso.net/notes/2025/amazon-crawler/ 263 comments
- AI Slop Is a Brute Force Attack on the Algorithms That Control Reality https://www.404media.co/ai-slop-is-a-brute-force-attack-on-the-algorithms-that-control-reality/ 201 comments
- AI haters build tarpits to trap and trick AI scrapers that ignore robots.txt - Ars Technica https://arstechnica.com/tech-policy/2025/01/ai-haters-build-tarpits-to-trap-and-trick-ai-scrapers-that-ignore-robots-txt/ 200 comments
- GitHub - ai-robots-txt/ai.robots.txt: A list of AI agents and robots to block. https://github.com/ai-robots-txt/ai.robots.txt 90 comments
- Please stop externalizing your costs directly into my face https://drewdevault.com/2025/03/17/2025-03-17-Stop-externalizing-your-costs-on-me.html 74 comments
- Sites scramble to block ChatGPT web crawler after instructions emerge | Ars Technica https://arstechnica.com/information-technology/2023/08/openai-details-how-to-keep-chatgpt-from-gobbling-up-website-data/ 73 comments
Related searches:
Search whole site: site:arstechnica.com
Search title: Devs say AI crawlers dominate traffic, forcing blocks on entire countries - Ars Technica
See how to search.