Drawbacks
According to the FAQ about Nutch, an open-source search engine website, the savings in bandwidth by distributed web crawling are not significant, since "A successful search engine requires more bandwidth to upload query result pages than its crawler needs to download pages...".
Read more about this topic: Distributed Web Crawling
Famous quotes containing the word drawbacks:
“France has neither winter nor summer nor morals—apart from these drawbacks it is a fine country.”
—Mark Twain [Samuel Langhorne Clemens] (1835–1910)