The text file that runs the internet

Article URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Comments URL: https://news.ycombinator.com/item?id=39414053

Points: 1

# Comments: 0