I deployed an app with a set of periodic tasks a week ago.
Everything went fine for a week - using heroku free instance as a worker
dyno (no web server active).
Yesterday afternoon, I started the web server for 10 minutes and shut it
down in the Heroku interface.
Since then it seems the worker is idling and it is not sending any periodic
task anymore.
It is crucial that the celerybeat worker sends jobs to the queue, and I
cannot understand why it didn't fire anything for 20 hours (when I have a
crucial but light task supposed to run every 5mn)
Can you please help me understand where this could come from?
Thanks!
Julien
heroku ps returns :
=== worker (1X): `newrelic-admin run-program python manage.py celeryd
worker -E --beat`
worker.1: up 2013/06/24 14:06:33 (~ 20h ago)
heroku logs returns :
2013-06-24T13:22:48.572285+00:00 app[worker.1]: 2013-06-24 13:22:48,571
(76/NR-Harvest-Thread) newrelic.core.data_collector WARNING - Data
collector is not contactable. This can be because of a network issue or
because of the data collector being restarted. In the event that contact
cannot be made after a period of time then please report this problem to
New Relic support for further investigation. The error raised was
ConnectionError(MaxRetryError('Max retries exceeded for url:
/agent_listener/invoke_raw_method?method=metric_data&marshal_format=json&protocol_version=12&license_key=fa8495a19b5bb16de4d2eed5b34b7e1472fb01b7&run_id=475642139',),).
2013-06-24T13:22:49.054718+00:00 app[worker.1]: [2013-06-24 13:22:48,571:
WARNING/MainProcess] Data collector is not contactable. This can be because
of a network issue or because of the data collector being restarted. In the
event that contact cannot be made after a period of time then please report
this problem to New Relic support for further investigation. The error
raised was ConnectionError(MaxRetryError('Max retries exceeded for url:
/agent_listener/invoke_raw_method?method=metric_data&marshal_format=json&protocol_version=12&license_key=fa8495a19b5bb16de4d2eed5b34b7e1472fb01b7&run_id=475642139',),).
2013-06-24T13:25:00.229379+00:00 app[worker.1]: [2013-06-24 13:25:00,229:
WARNING/PoolWorker-2] 2013-06-24 13:40:00.220318
2013-06-24T13:25:01.254134+00:00 app[worker.1]: [2013-06-24 13:25:00,229:
WARNING/PoolWorker-2] 0
2013-06-24T13:25:01.368111+00:00 app[worker.1]: [2013-06-24 13:25:00,229:
WARNING/PoolWorker-2] 0
2013-06-24T13:25:01.509915+00:00 app[worker.1]: [2013-06-24 13:25:00,229:
WARNING/PoolWorker-2] 0
2013-06-24T13:25:01.643564+00:00 app[worker.1]: [2013-06-24 13:25:00,229:
WARNING/PoolWorker-2] 0
2013-06-24T13:25:01.793807+00:00 app[worker.1]: [2013-06-24 13:25:00,230:
WARNING/PoolWorker-2] 0
2013-06-24T13:30:00.240448+00:00 app[worker.1]: [2013-06-24 13:30:00,240:
WARNING/PoolWorker-2] 2013-06-24 13:45:00.212859
2013-06-24T13:30:00.690447+00:00 app[worker.1]: [2013-06-24 13:30:00,240:
WARNING/PoolWorker-2] 0
2013-06-24T13:30:00.804900+00:00 app[worker.1]: [2013-06-24 13:30:00,240:
WARNING/PoolWorker-2] 0
2013-06-24T13:30:00.918547+00:00 app[worker.1]: [2013-06-24 13:30:00,240:
WARNING/PoolWorker-2] 0
2013-06-24T13:30:01.043060+00:00 app[worker.1]: [2013-06-24 13:30:00,240:
WARNING/PoolWorker-2] 0
2013-06-24T13:30:01.154690+00:00 app[worker.1]: [2013-06-24 13:30:00,241:
WARNING/PoolWorker-2] 0
These are the last lines of logs for the worker - no HXX were sent by
heroku for it.
--
--
You received this message because you are subscribed to the Google
Groups "Heroku" group.
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
---
You received this message because you are subscribed to the Google Groups
"Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/groups/opt_out.
