Hello, I have a screen scraper that I would like to call from web2py. I currently have a controller method that calls it and updates data in the DAL. The problem is, the number of users of this app is growing quickly. I need to queue the updates so I don't overwhelm the server that it is scraping.
I would like a cron script to fire off daily and set the queue in motion. I would like to limit the queue to update 5 users or so per minute. Any recommendations on attacking this problem? -- You received this message because you are subscribed to the Google Groups "web2py-users" group. To post to this group, send email to web...@googlegroups.com. To unsubscribe from this group, send email to web2py+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/web2py?hl=en.