You can use this. http://scrapy.org/ But do not run into web2py. Run it as a separate process and have web2py communicate to it by reading each other files or xmlrpc or the web2py scheduler.
On Friday, 26 February 2016 09:03:30 UTC-6, Marty Jones wrote: > > I have some familiarity with scraping but only from my local machine, not > from a server. I'd like to set up a basic scraping app as a web2py app that > I can eventually run on a server. Anybody seen any tutorials for anything > along these lines or know of a good module for doing this? > -- Resources: - http://web2py.com - http://web2py.com/book (Documentation) - http://github.com/web2py/web2py (Source code) - https://code.google.com/p/web2py/issues/list (Report Issues) --- You received this message because you are subscribed to the Google Groups "web2py-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to web2py+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.