Re: [Twisted-Python] Question regarding the working of twisted python with celery

2011-03-03 Thread Andrew Bennetts
Dinesh Kapoor wrote: [...] >4. When celery is run with concurrency of 2, then I tried printing out the >process ids of calling process in the reactor code, and I am getting 2 >different pids, so I am assuming there are two seperate copies of reactor >in those separate tasks. This s

Re: [Twisted-Python] Question regarding the working of twisted python with celery

2011-03-03 Thread Dinesh Kapoor
Thanks Reza and Jean-Paul for your response. Actually, I tried investigating a bit more that whether the reactor is in different process than the calling celery task, and it doesn't seem to be the case. The workflow that I am assuming is as follows: 1. Celery creates a worker process and assigns a

Re: [Twisted-Python] Question regarding the working of twisted python with celery

2011-03-02 Thread exarkun
On 09:42 am, dineshkapoo...@gmail.com wrote: >Hi, > > I have run into a weird performance issue while working with twisted >and >using celery to schedule tasks on it. Here is my setup: > >1. Celery schedules a task which makes a TCP connection to a server >running >FreeSwitch >2. Celery is runni

Re: [Twisted-Python] Question regarding the working of twisted python with celery

2011-03-02 Thread Reza Lotun
On Wed, Mar 2, 2011 at 9:42 AM, Dinesh Kapoor wrote: > 2. Celery is running with concurrency = 2. > 3. I have changed my code so that I call reactor.callfromthread for all > reactor based work. > 4. A lot of times once I schedule the celery task, I get delays ranging from > 3 - 30 seconds when I a

[Twisted-Python] Question regarding the working of twisted python with celery

2011-03-02 Thread Dinesh Kapoor
Hi, I have run into a weird performance issue while working with twisted and using celery to schedule tasks on it. Here is my setup: 1. Celery schedules a task which makes a TCP connection to a server running FreeSwitch 2. Celery is running with concurrency = 2. 3. I have changed my code so tha