I checked the tasks and I don't see excessive retries. The tasks do encounter error sometimes, but most of them are caught and handled inside the tasks without a retry. The errors that cause a retry (response 500) are very few.
The tasks do usually take more than 1 second (that's why I pushed that work into tasks). Robert, what's your point about > 1s tasks? Is there a penalty on long tasks? And if so, what's the logic behind it? So I increased the rate and bucket size, and I reduced the pending latency back to 'automatic' and increased the max idle instance to 40. That helped yesterday, but today I have the same problem. And it's with two queues this time. Many of these tasks are time sensitive and they need to run within a few seconds. An occasional delay of a minute or so is okay, but it's getting into the hours. Am I missing something obvious? Are there other settings that control the rate of queue execution? Waleed On Wed, Sep 7, 2011 at 10:35 PM, Robert Kluin <[email protected]>wrote: > When I adjusted those settings my performance was abismal. I like Vivek's > suggestion of moving one-at-a-time. > > Most likely your requests in that queue are taking over 1000ms, so they > aren't getting ran as quickly. Hopefully that is something that will change > with the new pricing. > > > Robert > > > On Wed, Sep 7, 2011 at 15:52, Waleed Abdulla <[email protected]> wrote: > >> I noticed today that the performance of my task queue has >> dropped considerably (see image). The highlighted queue is set to run 8 >> tasks/second (i.e. ~ 480 per minute) but it's running at 25% of that rate, >> and a backlog is building up. The only thing I changed recently is reducing >> my max idle instances to 20 and min pending latency to 100ms. >> >> Anyone else noticing something similar? any tips to get the task queue to >> run faster? >> >> >> >> [image: Screen shot 2011-09-07 at 1.26.22 PM.png] >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Google App Engine" group. >> To post to this group, send email to [email protected]. >> To unsubscribe from this group, send email to >> [email protected]. >> For more options, visit this group at >> http://groups.google.com/group/google-appengine?hl=en. >> > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
<<Screen shot 2011-09-07 at 1.26.22 PM.png>>
