“from Amazon. And if you go to Amazon's robots.txt page, as…” — The Vergecast at 12:30
“from Amazon. And if you go to Amazon's robots.txt page, as one does from time to time, Amazon does not allow any of the AI bots. Like anyone you can think of, it is blocking. And all of these bots have a long history of doing sketchy stuff to get around it. They present themselves as other things in order to crawl…”
0:00
1:48:49