EPISODE · Jul 31, 2024 · 46 MIN
Google, Reddit, and the Robots.txt Rebellion
from The 404 Media Podcast · host 404 Media
We've got a bumper episode today. First off, a whole series of stories about robots.txt and its increased use against AI, as well as Reddit only being available in Google results now (and not other search engines like DuckDuckGo). Then after the break, Sam discusses her amazing scoop which showed that multibillion dollar company Runway scraped videos from individual YouTube creators. In the subscribers-section, everyone educates Joseph on what Skibidi is. The Backlash Against AI Scraping Is Real and Measurable Websites are Blocking the Wrong AI Scrapers (Because AI Companies Keep Making New Ones) Google Is the Only Search Engine That Works on Reddit Now Thanks to AI Deal AI Video Generator Runway Trained on Thousands of YouTube Videos Without Permission Skibidi Toilet Copyright Takedown Request to Garry’s Mod Is Very Dumb Subscribe at 404media.co for bonus content. Learn more about your ad choices. Visit megaphone.fm/adchoices
What this episode covers
We've got a bumper episode today. First off, a whole series of stories about robots.txt and its increased use against AI, as well as Reddit only being available in Google results now (and not other search engines like DuckDuckGo). Then after the break, Sam discusses her amazing scoop which showed that multibillion dollar company Runway scraped videos from individual YouTube creators. In the subscribers-section, everyone educates Joseph on what Skibidi is. The Backlash Against AI Scraping Is Real and Measurable Websites are Blocking the Wrong AI Scrapers (Because AI Companies Keep Making New Ones) Google Is the Only Search Engine That Works on Reddit Now Thanks to AI Deal AI Video Generator Runway Trained on Thousands of YouTube Videos Without Permission Skibidi Toilet Copyright Takedown Request to Garry’s Mod Is Very Dumb Subscribe at 404media.co for bonus content. Learn more about your ad choices. Visit megaphone.fm/adchoices
NOW PLAYING
Google, Reddit, and the Robots.txt Rebellion
No transcript for this episode yet
Similar Episodes
Mar 26, 2026 ·1m
Mar 19, 2026 ·34m
Feb 18, 2026 ·11m
Feb 11, 2026 ·45m