"abhinav" <[EMAIL PROTECTED]> writes: > The crawler which will be working on huge set of pages should be > as fast as possible.
What kind of network connection do you have, that's fast enough that even a fairly cpu-inefficient crawler won't saturate it? -- http://mail.python.org/mailman/listinfo/python-list