Re: [Twisted-Python] Lots and lots and lots and lots... of deferreds

2009-10-06 Thread Steve Steiner (listsin)
On Oct 6, 2009, at 11:25 PM, Andrew Bennetts wrote: > Steve Steiner (listsin) wrote: > [...] >> I expect the usual flurry of "you must post your exact code or we >> can't help you at all, moron" posts, but... > > I'll try to restrain myself ;) Thanks, I appreciate your restraint. Must say

Re: [Twisted-Python] Lots and lots and lots and lots... of deferreds

2009-10-06 Thread Steve Steiner (listsin)
On Oct 6, 2009, at 10:57 PM, Glyph Lefkowitz wrote: However, you can experiment with it pretty easily using DeferredSemaphore: http://twistedmatrix.com/documents/8.2.0/api/twisted.internet.defer.DeferredSemaphore.html Cool, I didn't know about that, I'll give it a look. Thanks! If your app

Re: [Twisted-Python] Lots and lots and lots and lots... of deferreds

2009-10-06 Thread Andrew Bennetts
Steve Steiner (listsin) wrote: [...] > I expect the usual flurry of "you must post your exact code or we > can't help you at all, moron" posts, but... I'll try to restrain myself ;) > In spite of my not having posted specific code, could someone with > some actual experience in t

Re: [Twisted-Python] Lots and lots and lots and lots... of deferreds

2009-10-06 Thread Matt Perry
If everything is happening in a single thread, you probably don't need to lock anything, because there's no shared access and therefore no race conditions. I have no idea how your app is written, so you may need them - I don't know. Just an observation. - Matt On Tue, Oct 6, 2009 at 11:13 PM,

Re: [Twisted-Python] Lots and lots and lots and lots... of deferreds

2009-10-06 Thread Steve Steiner (listsin)
On Oct 6, 2009, at 11:00 PM, Matt Perry wrote: > One thing of note is that you say you have concurrency issues > handled -- but with asynchronous I/O, there are no concurrency > issues, since there's no concurrency (at least, not at application > level). This is confusing at first but it's

Re: [Twisted-Python] Lots and lots and lots and lots... of deferreds

2009-10-06 Thread Matt Perry
Your limit will usually be the number of file descriptors in the system, which can be usually changed via ulimit or your system's equivalent. On Linux I believe it defaults to 1024, so you should be able to handle 1024 simultaneous connections. One thing of note is that you say you have concurren

Re: [Twisted-Python] Lots and lots and lots and lots... of deferreds

2009-10-06 Thread Glyph Lefkowitz
On Tue, Oct 6, 2009 at 10:40 PM, Steve Steiner (listsin) < list...@integrateddevcorp.com> wrote: >Should I limit the number of "in-flight" pages? > I'm not going to comment on that, because I don't know what your app is doing or why it appears to be dying. As you said, you didn't post c