Shameless plug for a web scraping tool my son is involved in creating, called scrapelib. He is on leave from university and is a consultant for the Sunlight Foundation creating something called the Fifty States Project to monitor lobbyist money to state governments in the USA.
http://github.com/mikejs/scrapelib -- http://mail.python.org/mailman/listinfo/python-list
