mapreduce? Just how many requests will you be making to third-party sites at onc...

		imsteve on Jan 9, 2008 \| parent \| context \| favorite \| on: Ask YC: Any ideas about intelligent crawlers :) mapreduce? Just how many requests will you be making to third-party sites at once? Sounds like a good way to get blocked fast.