Hacker News
- Twitter just updated its robots.txt to exclude all scrapers https://www.twitter.com/robots.txt 19 comments
- Twitter.com/robots.txt # Crawl-delay: 10 -- Googlebot ignores crawl-delay ftl http://twitter.com/robots.txt 4 comments
Linking pages
- X updates its Terms to prohibit crawling/scraping of its data https://stackdiary.com/x-updates-its-terms-to-prohibit-crawling-scraping-of-its-data/ 100 comments
- Hands-on Web Scraping: Building your Twitter dataset with python and scrapy | by Amit Upreti | Towards Data Science https://towardsdatascience.com/hands-on-web-scraping-building-your-own-twitter-dataset-with-python-and-scrapy-8823fb7d0598 0 comments
Related searches:
Search whole site: site:twitter.com
Search title: Twitter just updated its robots.txt to exclude all scrapers
See how to search.