Re: [Twisted-Python] process output modulation

2010-12-21 Thread David
Thank you. I was thinking along those lines, but wasn't sure how the producer/consumer methods related to the streams model. I guess I still don't know, but I now have more confidence that a solution is there to find. I was considering a klunky workaround, where the db output is piped to a throt

Re: [Twisted-Python] process output modulation

2010-12-21 Thread exarkun
On 06:14 pm, dvkee...@gmail.com wrote: >We are streaming a large amount of program output to the browser via a >twisted app, and we are seeing huge memory consumption. > >We have a database process that generates large amounts of data to >stdout, and we are streaming that to the browser through a t

[Twisted-Python] process output modulation

2010-12-21 Thread David
We are streaming a large amount of program output to the browser via a twisted app, and we are seeing huge memory consumption. We have a database process that generates large amounts of data to stdout, and we are streaming that to the browser through a twisted web2 app. We are using web2 because