I have a django app that uses celery to do lots of polling and celery beat to schedule those. I use gevent instead of worker processes. It polls network devices using various things such as a vendor api, snmp, and, if needed, ssh to the command line.
What I think I am seeing is as follows. It looks like a long running task kicks off, apparently running quickly. However, when another tasks kicks off the original is interrupted. Once the interrupting task has finished or momentarily stops, the original task picks back up. Tasks that I have timed to take thirty to forty minutes stand alone can take up to two hours under celery with gevent. This leads me to wonder if I have reached a limit with using Celery/Gevent or am I doing something wrong with the way I have set up the tasks with app.task? Thanks, Mitch -- You received this message because you are subscribed to the Google Groups "Django users" group. To unsubscribe from this group and stop receiving emails from it, send an email to django-users+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/django-users/b76f190a-9599-4c60-b862-20b92a4f75e8n%40googlegroups.com.
