spidey

A dead-simple, concurrent web crawler which focuses on ease of use and speed.