[Twisted-Python] Job server

2010-12-21 Thread Umut Aydin
Hello everybody My job server is on progress and maybe you want to check it out. Distribution part is ready but I still work on remote calls. As soon as I get it done I ll write an article about building a job server with twisted framework. (I wrote an article about Apache Mina framework while des

Re: [Twisted-Python] Job server

2010-12-21 Thread Yaroslav Fedevych
On Tue, Dec 21, 2010 at 1:40 PM, Umut Aydin wrote: > Hello everybody > > My job server is on progress and maybe you want to check it out. > Distribution part is ready but I still work on remote calls. As soon > as I get it done I ll write an article about building a job server > with twisted frame

Re: [Twisted-Python] Job server

2010-12-21 Thread Umut Aydin
Hello I will write a README and INSTALL documents asap but I did not have anything about USAGE document in my mind. I will take care of it also. Thank you for your advice. Migrating a job during processing is not available yet but I think I can find a way to provide that within Multiple Job Handl

[Twisted-Python] process output modulation

2010-12-21 Thread David
We are streaming a large amount of program output to the browser via a twisted app, and we are seeing huge memory consumption. We have a database process that generates large amounts of data to stdout, and we are streaming that to the browser through a twisted web2 app. We are using web2 because

Re: [Twisted-Python] process output modulation

2010-12-21 Thread exarkun
On 06:14 pm, dvkee...@gmail.com wrote: >We are streaming a large amount of program output to the browser via a >twisted app, and we are seeing huge memory consumption. > >We have a database process that generates large amounts of data to >stdout, and we are streaming that to the browser through a t

Re: [Twisted-Python] process output modulation

2010-12-21 Thread David
Thank you. I was thinking along those lines, but wasn't sure how the producer/consumer methods related to the streams model. I guess I still don't know, but I now have more confidence that a solution is there to find. I was considering a klunky workaround, where the db output is piped to a throt