Web crawling

Crawl before you walk

An episode of the INLS490-154W: Information Retrieval Systems Design and Implementation podcast, hosted by Chirag Shah, titled "Web crawling" was published on November 3, 2009 and runs 58 minutes.

November 3, 2009 ·58m · INLS490-154W: Information Retrieval Systems Design and Implementation

Summary

This is the podcast for the eleventh class, in which we see traditional and non-traditional methods of collecting data off the web. Traditional way is demonstrated using web crawling using wget, and non-traditional way is instantiated with YouTube harvesting.

Episode Description