I like this, I can simply insert sleep statements to keep it from being to aggressive with this approach.
Would this be best in system cron? On Feb 18, 1:31 pm, mdipierro <mdipie...@cs.depaul.edu> wrote: > I would run a separate process > > web2py.py -S yourapp -M -R yourscript.py > > On Feb 18, 1:31 pm, Kevin Bowling <kevin.bowl...@gmail.com> wrote: > > > Hello, > > > I have a screen scraper that I would like to call from web2py. I > > currently have a controller method that calls it and updates data in > > the DAL. The problem is, the number of users of this app is growing > > quickly. I need to queue the updates so I don't overwhelm the server > > that it is scraping. > > > I would like a cron script to fire off daily and set the queue in > > motion. I would like to limit the queue to update 5 users or so per > > minute. > > > Any recommendations on attacking this problem? -- You received this message because you are subscribed to the Google Groups "web2py-users" group. To post to this group, send email to web...@googlegroups.com. To unsubscribe from this group, send email to web2py+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/web2py?hl=en.