Does a web crawler have to download an entire page if it only needs to check if the product is in stock on a page? Or if it just needs to search for one match of a certain word on a page?
-- http://mail.python.org/mailman/listinfo/python-list
Does a web crawler have to download an entire page if it only needs to check if the product is in stock on a page? Or if it just needs to search for one match of a certain word on a page?
-- http://mail.python.org/mailman/listinfo/python-list