Google, Reddit, and the Robots.txt Rebellion episode artwork

EPISODE · Jul 31, 2024 · 46 MIN

Google, Reddit, and the Robots.txt Rebellion

from The 404 Media Podcast · host 404 Media

We've got a bumper episode today. First off, a whole series of stories about robots.txt and its increased use against AI, as well as Reddit only being available in Google results now (and not other search engines like DuckDuckGo). Then after the break, Sam discusses her amazing scoop which showed that multibillion dollar company Runway scraped videos from individual YouTube creators. In the subscribers-section, everyone educates Joseph on what Skibidi is. The Backlash Against AI Scraping Is Real and Measurable Websites are Blocking the Wrong AI Scrapers (Because AI Companies Keep Making New Ones) Google Is the Only Search Engine That Works on Reddit Now Thanks to AI Deal AI Video Generator Runway Trained on Thousands of YouTube Videos Without Permission Skibidi Toilet Copyright Takedown Request to Garry’s Mod Is Very Dumb Subscribe at 404media.co for bonus content. Learn more about your ad choices. Visit megaphone.fm/adchoices

We've got a bumper episode today. First off, a whole series of stories about robots.txt and its increased use against AI, as well as Reddit only being available in Google results now (and not other search engines like DuckDuckGo). Then after the break, Sam discusses her amazing scoop which showed that multibillion dollar company Runway scraped videos from individual YouTube creators. In the subscribers-section, everyone educates Joseph on what Skibidi is. The Backlash Against AI Scraping Is Real and Measurable Websites are Blocking the Wrong AI Scrapers (Because AI Companies Keep Making New Ones) Google Is the Only Search Engine That Works on Reddit Now Thanks to AI Deal AI Video Generator Runway Trained on Thousands of YouTube Videos Without Permission Skibidi Toilet Copyright Takedown Request to Garry’s Mod Is Very Dumb Subscribe at 404media.co for bonus content. Learn more about your ad choices. Visit megaphone.fm/adchoices

NOW PLAYING

Google, Reddit, and the Robots.txt Rebellion

0:00 46:05

No transcript for this episode yet

We transcribe on demand. Request one and we'll notify you when it's ready — usually under 10 minutes.

Frequently Asked Questions

How long is this episode of The 404 Media Podcast?

This episode is 46 minutes long.

When was this The 404 Media Podcast episode published?

This episode was published on July 31, 2024.

What is this episode about?

We've got a bumper episode today. First off, a whole series of stories about robots.txt and its increased use against AI, as well as Reddit only being available in Google results now (and not other search engines like DuckDuckGo). Then after the...

Can I download this The 404 Media Podcast episode?

Yes, you can download this episode by clicking the download button on the episode player, or subscribe to the podcast in your preferred podcast app for automatic downloads.
URL copied to clipboard!