EPISODE · Nov 15, 2025 · 17 MIN
AI 스크레이퍼에게 쓰레기 데이터 먹이기
from misc. LM · host m.s.s.
웹사이트 운영자가 대규모 언어 모델(LLM) 훈련을 위한 공격적이고 끊임없는 웹 스크래퍼에 대응하기 위해 취한 조치를 개괄합니다. 작성자는 전통적인 차단 방식이 효과가 없으며, 심지어 IP 주소를 요청당 하나씩 바꾸는 봇들 때문에 대역폭과 서버 자원이 소모된다고 설명합니다. 이에 대한 해결책으로, 작성자는 사용자에게 불편을 주지 않으면서 마르코프 연쇄 기법을 사용하여 서버 자원을 매우 적게 소모하는 무가치한 '쓰레기' 콘텐츠를 동적으로 생성해 스크래퍼에게 먹이는 전략을 택했습니다.
Embed this episode
NOW PLAYING
AI 스크레이퍼에게 쓰레기 데이터 먹이기
0:00
17:31
1×
No transcript for this episode yet
Similar Episodes
No similar episodes found.
Similar Podcasts
Pollinators & Pods: The AI Guide to Milkweed and Insect Life
Grow Milkweed Plants Network
Welcome to "Pollinators & Pods" a podcast where artificial intelligence meets the natural world. Join us as we explore the fascinating relationships between milkweed plants and the diverse insects they attract. Using cutting-edge AI from Notebook LM, we distill complex scientific journals into accessible and engaging summaries. Each episode dives into the critical role milkweed plays in supporting pollinators and contributing to biodiversity. Whether you're a botany enthusiast, an ecologist, or simply curious about the intricate connections between plants and wildlife, this podcast offers insightful, AI-generated content that highlights the importance of milkweed in sustaining ecosystems. Pollinators & Pods Is a part of the Grow Milkweed Plants podcast network.
Headless Deep Dive Podcast
HeadlessDeepDive.substack.com
Exploring the intersection of the Headless Way with the worlds of Philosophy, Science, and Religion. I like to use Artificial Intelligence to reflect back to us what humanity looks like from another point of view. This podcast is a feed of the Deep Dive podcast generated by Google's Notebook LM customized with handpicked content just for the Headless Deep dive audience. headlessdeepdive.substack.com
Frequently Asked Questions
How long is this episode of misc. LM?
This episode is 17 minutes long.
When was this misc. LM episode published?
This episode was published on November 15, 2025.
Can I download this misc. LM episode?
Yes. Use the download control on the episode player to save the publisher-provided media file.
URL copied to clipboard!