Hi Risto, I think there were a few times when the taskqueue was not executing tasks properly over the past week or so, I noticed tasks backing up too.
If you are not already, you might try to distribute your tasks across several queues. I frequently see some queues slow down while others keep running tasks properly. Robert On Thu, Jan 20, 2011 at 21:48, Risto Haukioja <[email protected]> wrote: > Hi, > I've been running robustly on appengine for the last several months, with a > lot of work done by my taskqueue workers. ( tasks are querying data using > the twitter apis ) > Since the last few days, a lot of my tasks are piling up and staying in the > queue for extended time periods. I don't see excessive rates of failing > tasks. It seems like the tasks are just sitting there and piling up ( I run > the tasks with a cron job every 10 minutes ) and consequently also causing > more requests towards the twitter apis. > Is this something others are seeing as well? > Previously I wrote my app, to catch on timeouts ( of 30 seconds or so ) and > reschedule another task to finish the work. With the new 10 minute task > validity time the same timout model is probably breaking my tasks. Is the > 10 minute task validity time default for all tasks at the moment? > appid: socicount > thanks, > risto > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
